CSE 733/833: Natural Language Processing

Course Description

NLP techniques are the crux of many leading modern technologies.

Advances in NLP are also critical in the pursuit of Artificial Intelligence.

This course will discuss core problems in NLP, the state-of-the-art tools and techniques, as well as advanced NLP research topics.

At the end of the course, you will be familiar with many language-processing tasks and applications. You will also have gained hands-on experience via an exciting NLP project.

Office Hours

Friday: 2:00 pm - 3:00 pm and by appointment

Topics

Textbooks

There is no official textbook for the course. The course content will be based on research papers published in the premier conferences such as ACL and EMNLP.

Grading Criteria

Attendance

Optional. Lectures will be screen-recorded and posted on Canvas

Honor Code

Please refer to the statement on academic integrity given below.

By attending Old Dominion University you have accepted the responsibility to abide by the honor code. If you are uncertain about how the honor code applies to any course activity, you should request clarification from the instructor. The honor code is as follows:

“I pledge to support the honor system of Old Dominion University. I will refrain from any form of academic dishonesty or deception, such as cheating or plagiarism. I am aware that as a member if the academic community, it is my responsibility to turn in all suspected violators of the honor system. I will report to Honor Council hearings if summoned.”

In particular, submitting anything that is not your own work without proper attribution (giving credit to the original author) is plagiarism and is considered to be an honor code violation. It is not acceptable to copy source code or written work from any other source (including other students), unless explicitly allowed in the assignment statement. In cases where using resources such as the Internet is allowed, proper attribution must be given.

Any evidence of an honor code violation (cheating) will result in a 0 grade for the assignment/exam, and the incident will be submitted to the Department of Computer Science for further review. Evidence of cheating may include a student being unable to satisfactorily answer questions asked by the instructor about a submitted solution. Cheating includes not only receiving unauthorized assistance, but also giving unauthorized assistance.

Students may still provide legitimate assistance to one another. You are encouraged to form study groups to discuss course topics. Students should avoid discussions of solutions to ongoing assignments and should not, under any circumstances, show or share code solutions for an ongoing assignment.

Please see the ODU Honor Council’s webpage for other concrete examples of what constitutes cheating, plagiarism, and unauthorized collaboration. All students are responsible for knowing the rules. If you are unclear about whether a certain activity is allowed or not, please contact the instructor.

Content

Introduction

NLP Applications - 1

NLP Applications - 2

NLP Applications - 3

Project Ideas

Word Embedding

Transformers and Contextual Embedding

Text Classification

Sentiment Analysis

BERT