IS4200/CS6200: Information Retrieval

Fall 2012 Syllabus

Return to basic course information.

This schedule is subject to change. Check back as the class progresses.

CMS refers to Search Engines by Croft, Metzler, and Strohman; MRS refers to Introduction to Information Retrieval by Manning, Raghavan, and Schütze.

1. Overview of Information Retrieval (6 Sept. 2012)
   • Reading: CRS chap. 1
2. Architecture of a Search Engine (6 & 13 Sept. 2012)
   • Reading: CRS ch. 2
3. Acquiring Data (13 Sept. 2012)
   • Reading: CRS chap. 3; MRS chap. 19 and 20
   • Crawling the Web
   • Document Conversion
   • Storing the Documents
   • Detecting Duplicates
   • Noise Detection and Removal
4. Processing Text (20 Sept. 2012)
   • Reading: CRS chap. 4; MRS chap. 2 and 21
   • Text Statistics
   • Document Parsing
   • Tokenizing
   • Stopping
   • Stemming
   • Phrases
   • Document Structure
   • Link Extraction
   • More detail on PageRank (27 Sept.)
   • Feature Extraction and Named Entity Recognition (27 Sept.)
   • Internationalization
5. Ranking with Indexes (4 Oct.)
   • Abstract Model of Ranking
   • Inverted indexes
   • MapReduce
   • Query Processing
     • Document-at-a-time evaluation
     • Term-at-a-time evaluation
     • Optimization techniques
     • Structured queries
     • Distributed evaluation
     • Caching
6. Queries and Interfaces (11 Oct.)
   • Information Needs and Queries
   • Query Transformation and Refinement
     • Stopping and Stemming Revisited
     • Spell Checking and Query Suggestions
     • Query Expansion
     • Relevance Feedback
     • Context and Personalization
   • Displaying the Results
     • Result Pages and Snippets
     • Advertising and Search
     • Clustering the Results
     • Translation
   • User Behavior Analysis
7. Retrieval Models (18, 25 Oct.)
   • Overview of Retrieval Models
     • Boolean Retrieval
     • The Vector Space Model
   • Probabilistic Models
     • Information Retrieval as Classification
     • The BM25 Ranking Algorithm
   • Ranking based on Language Models
     • Query Likelihood Ranking
     • Relevance Models and Pseudo-Relevance Feedback
   • Complex Queries and Combining Evidence
     • The Inference Network Model
     • The Galago Query Language
   • Models for Web search
   • Machine Learning and Information Retrieval
8. Evaluating Search Engines (25 Oct.)
   • Test collections
   • Query logs
   • Effectiveness Metrics
     • Recall and Precision
     • Averaging and interpolation
     • Focusing on the top documents
   • Training, Testing, and Statistics
     • Significance tests
     • Setting parameter values
9. Classification and Clustering (see also last term's further slides on clustering and classification) (1 Nov.)
10. User Modeling (8 Nov.)
11. Social Search (8 Nov.)
    • User tagging
    • Searching within Communities
    • Filtering and recommending
    ond Bag of Words (15 Nov.)
    • Feature-Based Retrieval Models
    • Term Dependence Models
    • Question Answering
    • Pictures, Pictures of Words, etc.
12. XML Retrieval, Distributed IR, and Metasearch (29 Nov.)