Week 11: Content Delivery

Kafka

• Purpose of Kafka
• Publishers (producers), subscribers (consumers)
• Role of message broker
• Topics
• Partitions & partitioned logs
• Durable logs
• Replicated logs: leaders and followers
• Consumers and consumer groups
• Scaling to handle higher message volumes
• Scaling to handle more processing workloads
• Queuing vs. publish-subscribe

Content Delivery Networks

• Flash crowd problem, slashdot effect
• Network edge
• Caching
• Caching proxy
• Benefits of load balancer
• Multihoming
• Content Delivery Network (CDN)
• Push CDN vs. Pull CDN
• Overlay network
• Mapping system
• Dynamic DNS server
• Akamai domain name lookup
• Origin server
• Transport system
• Parent content servers vs. edge content servers
• Security benefits of a CDN
• Load shedding
• Adaptive bitrate coding (ABR)

Peer-to-Peer Content Delivery

• BitTorrent
  • Purpose of .torrent file
  • Purpose of seed nodes
  • Purpose of trackers
  • Seeders vs. leechers
  • Content publishing, search, download