Schedule

CS 636 Graduate Operating Systems 

Fall 2015

Lecture: LS 307 TR 4:35pm-6:20pm

Office Hours

Greg Benson: Tue/Thu 2:40pm-3:30pm, Wed 11:10am-12:00pm, and by appointment

Canvas (enrolled students only): https://usfca.instructure.com/courses/1553684
Piazza (enrolled students only): https://piazza.com/usfca/fall2015/cs636/home


Week 16

Tue Dec 7
  • Project 3 Presentations

Week 15

Thu Dec 2
  • Guest speaker: Josh Wills, Director of Data Engineering at Slack (formally director of Data Science at Cloudera).
Tue Dec 1
  • Paper 8: Kafka: A Distributed Messaging System for Log Processing (PDF)
    • No Eval required

Week 14

Thu Nov 26
  • Thanksgiving Break
Tue Nov 24
  • Continue discussion of Paper 7 (Spark Streaming)

Week 13

Thu Nov 19
  • Paper 7: Discretized Streams: Fault-Tolerant Streaming Computation at Scale by M. Zaharia, T. Das, H. Li, T. Hunter, S. Shenker, I. Stoica. (PDF)
    • Evals due Monday, Nov 16  at 11:59pm
Tue Nov 17
  • Discuss Project 3 - RDDs

Week 12

Thu Nov 12
  • Spark discussion
  • RDD implementation in Python

Tue Nov 10
  • Paper 6: Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing by M. Zaharia, M. Chowdhury, T. Das, A. Dave, J. Ma, M. McCauley, M. J., Franklin, S. Shenker, I. Stoica. (PDF)
    • Evals due Monday, Nov 9th at 11:59pm
Week 11

Thu  Nov 5
  • Midterm review
  • Introduction to Spark
Tue Nov 3
  • Midterm
    • Sample midterms: Spring 2015 (PDF), Spring 2014 (PDF)
Week 10

Thu Oct 29
  • Project 2 Presentations

Tue Oct 27
  • Project 2 Presentations

Week 9

Thu Oct 22
  • Project 2 Presentations

Tue Oct 20
  • Fall Break - No class

Week 8

Thu Oct 15
  • Guest Speaker: Shuvayu Kanjilal, Architect, Data Platform at AppDynamics.
Tue Oct 13
  • Continue Raft discussion (video mark 35 mins)
  • Python, ZeroRPC, Gevent, Greenlets

Week 7

Thu Oct 8
Tue Oct 6
  • Raft Video
  • Python Development

Week 6

Thu Oct 1 2015
  • Paper 4: The Google File System by S. Ghemawat, H. Gobioff, and S. Leung (PDF)
    • Evals due on Wednesday, Sep 30 at 11:59pm in Canvas.

Tue Sep 29 2015
  • Paper 3: The Anatomy of MapReduce Jobs, Scheduling, and Performance Challenges by S. Bardhan and D. A. Menascé (PDF)
    • Evals due Monday, Sep 28 at 11:59pm in Canvas.
  • Extra: MapReduce Patterns

Week 5

Thu Sep 24 2015

Tue Sep 22 2015
  • Paper 2: MapReduce: Simplified Data Processing on Large Clusters by J. Dean and S. Ghemawat (PDF)
    • Evals due Monday, Sep 21 at 11:59pm in Canvas

Week 4

Thu Sep 17 2015
  • Discuss Invitation Algorithm
  • Python
    • Greenlets, Gevent, ZeroMQ, ZeroRPC
Tue Sep 15 2015
  • Walk through Bully Algorithm Code (bully.py)
  • Introduce ZeroRPC

Week 3

Thu Sep 10 2015
  • Paper 1Elections in a Distributed Computing System by H. Garcia-Molina (PDF)
    • Evals due on Wednesday, Sep 9 at 11:59pm in Canvas.
Tue Sep 8 2015

Week 2

Thu Sep 3 2015
  • Discuss DSFP Chapters 2 and 3
  • Project 1
  • Python

Tue Sep 1 2015
  • Discuss DSFP Chapter 2
  • Python

Week 1

Thu Aug 27 2015
  • Discuss DSFP Chapter 1
  • Introduction to Python
  • Reading DSFP Chapter 2

Tue Aug 25 2015
Ċ
Greg Benson,
Sep 3, 2015, 4:27 PM
ċ
bully.py
(6k)
Greg Benson,
Sep 17, 2015, 5:16 PM
Ċ
Greg Benson,
Oct 29, 2015, 4:23 PM
Ċ
Greg Benson,
Oct 29, 2015, 4:26 PM