[Busec] BUsec this week (sort of): Frank McSherry (Mon 11AM)

Sharon Goldberg goldbe at cs.bu.edu
Sun Dec 16 17:32:34 EST 2012


Hi all,

Tomorrow at 11AM in MCS148, Frank McSherry from MSR will be giving the
department colloquium.  Frank will be telling us about his new line of
research on the design and implementation of distributed systems.  This
won't be a security or crypto talk, but will be exciting nonetheless :)
Abstract below, and lunch will be provided as usual.

See you tomorrow,
Sharon

---------- Forwarded message ----------

Title: Naiad: a system for incremental, iterative and interactive parallel
computation
Speaker: Frank McSherry, MSR
Monday, December 17, 2012, 11AM -12PM. In MCS148

Abstract:
We are developing a new system for large-scale data analysis -- called
"Naiad" -- which has the goal of supporting complex iterative queries
over dynamic inputs at interactive timescales. Like many existing
systems, Naiad supports high-level declarative queries, data-parallel
execution, and transparent distribution. Unlike these systems, Naiad
can efficiently execute queries with multiple (possibly nested)
iterative loops, while simultaneously supporting low-latency
incremental changes to the query inputs. As a highlight of its
characteristics, Naiad can not only efficiently compute the strongly
connected component structure of a 24 hour sliding window of the
Twitter @mention graph (using a doubly nested fixed-point
computation), but also maintains the computation with sub-second
latencies in the face of Twitter's full volume of continuously
arriving tweets.

I will describe the computational model underlying Naiad, a
generalization of traditional incremental dataflow to partially
ordered logical times, and work through some of the (very friendly,
picture oriented) mathematical details. I will also highlight several
new distributed systems challenges faced in order to fully realize the
multiple orders-of-magnitude performance improvements Naiad presents.

This is joint work with Derek Murray, Rebecca Isaacs, Michael Isard
and Martìn Abadi.

Lunch will follow the talk in 135.



-- 
Sharon Goldberg
Computer Science, Boston University
http://www.cs.bu.edu/~goldbe



-- 
Sharon Goldberg
Computer Science, Boston University
http://www.cs.bu.edu/~goldbe
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://cs-mailman.bu.edu/pipermail/busec/attachments/20121216/b7d13b31/attachment.html>


More information about the Busec mailing list