Taming Distributed Architectures Track for QconSF [Nov 18th 2015]<\/li>\n<\/ul>\n\n\n\nTalks<\/h2>\n\n\n\nOrleans: A Framework for Cloud Computing<\/h3>\n\n\n\n
Presented at Papers We Love SF: Video\u00a0&\u00a0Slides\u00a0[February 19th 2015]<\/p>\n\n\n\n
Abstract<\/h4>\n\n\n\n
Caitie McCaffrey stops by and talks about the Orleans: Distributed Virtual Actors for Programmability and Scalability paper by Bernstein, Bykov, Geller, Kliot, and Thelin.<\/p>\n\n\n\n
Orleans is a runtime and programming model for building scalable distributed systems, based on the actor model. The Orleans programming model introduces the abstraction of Virtual Actors. Orleans allows applications to obtain high performance, reliability, and scalability. This technology was developed by the eXtreme Computing Group at Microsoft Research and was a core component of the Azure Services that supported that powered Halo 4, the award winning video game.<\/p>\n\n\n\n
Building the Halo 4 Services with Orleans<\/h3>\n\n\n\n
Abstract<\/p>\n\n\n\n
Halo 4 is a first-person shooter on the Xbox 360, with fast-paced, competitive gameplay. To complement the code on disc, a set of services were developed to store player statistics, display player presence information, deliver daily challenges, modify playlists, catch cheaters and more. As of June 2013 Halo 4 had 11.6 million players, who played 1.5 billion games, logging 270 million hours of gameplay.<\/p>\n\n\n\n
Orleans, Distributed Virtual Actors for Programmability & Scalability, is an actor framework & runtime for building high scale distributed systems. It came from the eXtreme computing group in Microsoft Research, and is now Open Source on Github.<\/p>\n\n\n\n
For Halo 4, 343 Industries built and deployed a new set of services built from the ground up to support high demand, low latency, and high availability using using Orleans and running in Window Azure. This talk will do an overview of Orleans, the challenges faced when building the Halo 4 services, and why the Actor Model and Orleans in particular were utilized to solve these problems.<\/p>\n\n\n\n
Architecting & Launching the Halo 4 Services<\/h3>\n\n\n\n
Presented as the Closing Keynote of SRECon15: Video &\u00a0Slides\u00a0[March 17th 2015]<\/p>\n\n\n\n
Abstract<\/h4>\n\n\n\n
The Halo 4 services were built from the ground up to support high demand, low latency, and high availability. In addition, video games have unique load patterns where the majority of the traffic and sales occurs within the first few weeks after launch, making this a critical time period for the game and supporting services. Halo 4 went from 0 to 1 million users on day 1, and 4 million users within the first week.<\/p>\n\n\n\n
This talk will discuss the architectural challenges faced when building these services and how they were solved using Windows Azure and Project Orleans. In addition, we\u2019ll discuss the path to production, some of the difficulties faced, and the tooling and practices that made the launch successful.<\/p>\n\n\n\n
The Saga Pattern<\/h3>\n\n\n\n
Presented at Craft Conf 2015 & Goto: Chicago 2015\u00a0Video\u00a0&\u00a0Slides\u00a0[April 23rd 2015 & May 12th 2015]<\/p>\n\n\n\n
Abstract<\/h4>\n\n\n\n
As we build larger more complex applications and solutions that need to do collaborative processing the traditional ACID transaction model using coordinated 2-phase commit is often no longer suitable. More frequently we have long lived transactions or must act upon resources distributed across various locations and trust boundaries. The Saga Pattern is a useful model for long lived activities and distributed transactions without coordination.<\/p>\n\n\n\n
Sagas split work into a set of transactions whose effects can be reversed even after the work has been performed or committed. If a failure occurs compensating transactions are performed to rollback the work. So at its core the Saga is a failure Management Pattern, making it particularly applicable to distributed systems.<\/p>\n\n\n\n
In this talk, I\u2019ll discuss the fundamentals of the Saga Pattern, and how it can be applied to your systems. In addition we\u2019ll discuss how the Halo 4 Services successfully made use of the Saga Pattern when processing game statistics, and how we implemented it in production.<\/p>\n\n\n\n
Scaling Stateful Services<\/h3>\n\n\n\n
Presented at StrangeLoop 2015\u00a0Video & Slides\u00a0[September 25th 2015]<\/p>\n\n\n\n
This talk was incredibly well received, and I was flattered to see write-ups of it featured in High Scalability and InfoQ<\/p>\n\n\n\n
Abstract<\/h4>\n\n\n\n
The Stateless Service design principle has become ubiquitous in the tech industry for creating horizontally scalable services. However our applications do have state, we just have moved all of it to caches and databases. Today as applications are becoming more data intensive and request latencies are expected to be incredibly low, we\u2019d like the benefits of stateful services, like data locality and sticky consistency. In this talk I will address the benefits of stateful services, how to build them so that they scale, and discuss projects from Halo and Twitter of highly distributed and scalable services that implement these techniques successfully.d<\/p>\n\n\n\n
On the Order of Billions<\/h3>\n\n\n\n
Abstract<\/p>\n\n\n\n
Every minute Twitter\u2019s Observability stack processes 2+ billion metrics in order to provide Visibility into Twitter\u2019s distributed microservices architecture. This talk will focus on some of the challenges associated with building and running this large scale distributed system. We will also focus on lessons learned and how to build services that scale that are applicable for services of any size.<\/p>\n\n\n\n
So We Hear You Like Papers<\/h3>\n\n\n\n
Presented as the Evening Keynote at QconSF with Ines Sombra: Video, Slides, Resources, & Moment\u00a0[November 16th 2015]<\/p>\n\n\n\n
Abstract<\/h4>\n\n\n\n
Surprisingly enough academic papers can be interesting and very relevant to the work we do as computer science practitioners. Papers come in many kinds\/ areas of focus and sometimes finding the right one can be difficult. But when you do, it can radically change your perspective and introduce you to new ideas.<\/p>\n\n\n\n
Distributed Systems has been an active area of research since the 1960s, and many of the problems we face today in our industry have already had solutions proposed, and have inspired new research. Join us for a guided tour of papers from past and present research that have reshaped the way we think about building large scale distributed systems.<\/p>\n","protected":false},"excerpt":{"rendered":"
2015 has been a whirlwind of a year, which started off in a new city, with a new job as the Tech Lead of \u00a0Observability at Twitter. \u00a0The year was full of travel spanning 10 states, 3 different countries, and 2 continents. \u00a0This year I also had numerous opportunities to…<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4],"tags":[],"class_list":["post-39","post","type-post","status-publish","format-standard","hentry","category-tech-insights"],"yoast_head":"\n
2015: A Year in\u00a0Review - caitiem.com<\/title>\n<meta name=\"description\" content=\"2015 has been a whirlwind of a year, which started off in a new city, with a new job as the Tech Lead of \u00a0Observability at Twitter. \u00a0The year was full of travel spanning 10 states, 3 different countries, and 2 continents. \u00a0This year I also had numerous opportunities to share my experiences with programming and distributed systems via, talks, blog posts, podcasts, and articles. \u00a0Below is the recap.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"http:\/\/www.caitiem.com\/2015\/12\/26\/2015-a-year-in-review\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"2015: A Year in\u00a0Review - caitiem.com\" \/>\n<meta property=\"og:description\" content=\"2015 has been a whirlwind of a year, which started off in a new city, with a new job as the Tech Lead of \u00a0Observability at Twitter. \u00a0The year was full of travel spanning 10 states, 3 different countries, and 2 continents. \u00a0This year I also had numerous opportunities to share my experiences with programming and distributed systems via, talks, blog posts, podcasts, and articles. \u00a0Below is the recap.\" \/>\n<meta property=\"og:url\" content=\"http:\/\/www.caitiem.com\/2015\/12\/26\/2015-a-year-in-review\/\" \/>\n<meta property=\"og:site_name\" content=\"caitiem.com\" \/>\n<meta property=\"article:published_time\" content=\"2024-02-13T11:20:35+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-02-13T12:28:29+00:00\" \/>\n<meta name=\"author\" content=\"caiti335\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"caiti335\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"http:\/\/www.caitiem.com\/2015\/12\/26\/2015-a-year-in-review\/\",\"url\":\"http:\/\/www.caitiem.com\/2015\/12\/26\/2015-a-year-in-review\/\",\"name\":\"2015: A Year in\u00a0Review - caitiem.com\",\"isPartOf\":{\"@id\":\"https:\/\/www.caitiem.com\/#website\"},\"datePublished\":\"2024-02-13T11:20:35+00:00\",\"dateModified\":\"2024-02-13T12:28:29+00:00\",\"author\":{\"@id\":\"https:\/\/www.caitiem.com\/#\/schema\/person\/0ea20eb328afb663a23dc72ebeced8c0\"},\"description\":\"2015 has been a whirlwind of a year, which started off in a new city, with a new job as the Tech Lead of \u00a0Observability at Twitter. \u00a0The year was full of travel spanning 10 states, 3 different countries, and 2 continents. \u00a0This year I also had numerous opportunities to share my experiences with programming and distributed systems via, talks, blog posts, podcasts, and articles. \u00a0Below is the recap.\",\"breadcrumb\":{\"@id\":\"http:\/\/www.caitiem.com\/2015\/12\/26\/2015-a-year-in-review\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"http:\/\/www.caitiem.com\/2015\/12\/26\/2015-a-year-in-review\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"http:\/\/www.caitiem.com\/2015\/12\/26\/2015-a-year-in-review\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"\u0413\u043b\u0430\u0432\u043d\u0430\u044f \u0441\u0442\u0440\u0430\u043d\u0438\u0446\u0430\",\"item\":\"http:\/\/www.caitiem.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"2015: A Year in\u00a0Review\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.caitiem.com\/#website\",\"url\":\"https:\/\/www.caitiem.com\/\",\"name\":\"caitiem.com\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.caitiem.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.caitiem.com\/#\/schema\/person\/0ea20eb328afb663a23dc72ebeced8c0\",\"name\":\"caiti335\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.caitiem.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/08e6287ee41d891ed906aa45a965ba3c?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/08e6287ee41d891ed906aa45a965ba3c?s=96&d=mm&r=g\",\"caption\":\"caiti335\"},\"url\":\"https:\/\/www.caitiem.com\/author\/caiti335\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"2015: A Year in\u00a0Review - caitiem.com","description":"2015 has been a whirlwind of a year, which started off in a new city, with a new job as the Tech Lead of \u00a0Observability at Twitter. \u00a0The year was full of travel spanning 10 states, 3 different countries, and 2 continents. \u00a0This year I also had numerous opportunities to share my experiences with programming and distributed systems via, talks, blog posts, podcasts, and articles. \u00a0Below is the recap.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"http:\/\/www.caitiem.com\/2015\/12\/26\/2015-a-year-in-review\/","og_locale":"en_US","og_type":"article","og_title":"2015: A Year in\u00a0Review - caitiem.com","og_description":"2015 has been a whirlwind of a year, which started off in a new city, with a new job as the Tech Lead of \u00a0Observability at Twitter. \u00a0The year was full of travel spanning 10 states, 3 different countries, and 2 continents. \u00a0This year I also had numerous opportunities to share my experiences with programming and distributed systems via, talks, blog posts, podcasts, and articles. \u00a0Below is the recap.","og_url":"http:\/\/www.caitiem.com\/2015\/12\/26\/2015-a-year-in-review\/","og_site_name":"caitiem.com","article_published_time":"2024-02-13T11:20:35+00:00","article_modified_time":"2024-02-13T12:28:29+00:00","author":"caiti335","twitter_card":"summary_large_image","twitter_misc":{"Written by":"caiti335","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"http:\/\/www.caitiem.com\/2015\/12\/26\/2015-a-year-in-review\/","url":"http:\/\/www.caitiem.com\/2015\/12\/26\/2015-a-year-in-review\/","name":"2015: A Year in\u00a0Review - caitiem.com","isPartOf":{"@id":"https:\/\/www.caitiem.com\/#website"},"datePublished":"2024-02-13T11:20:35+00:00","dateModified":"2024-02-13T12:28:29+00:00","author":{"@id":"https:\/\/www.caitiem.com\/#\/schema\/person\/0ea20eb328afb663a23dc72ebeced8c0"},"description":"2015 has been a whirlwind of a year, which started off in a new city, with a new job as the Tech Lead of \u00a0Observability at Twitter. \u00a0The year was full of travel spanning 10 states, 3 different countries, and 2 continents. \u00a0This year I also had numerous opportunities to share my experiences with programming and distributed systems via, talks, blog posts, podcasts, and articles. \u00a0Below is the recap.","breadcrumb":{"@id":"http:\/\/www.caitiem.com\/2015\/12\/26\/2015-a-year-in-review\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["http:\/\/www.caitiem.com\/2015\/12\/26\/2015-a-year-in-review\/"]}]},{"@type":"BreadcrumbList","@id":"http:\/\/www.caitiem.com\/2015\/12\/26\/2015-a-year-in-review\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"\u0413\u043b\u0430\u0432\u043d\u0430\u044f \u0441\u0442\u0440\u0430\u043d\u0438\u0446\u0430","item":"http:\/\/www.caitiem.com\/"},{"@type":"ListItem","position":2,"name":"2015: A Year in\u00a0Review"}]},{"@type":"WebSite","@id":"https:\/\/www.caitiem.com\/#website","url":"https:\/\/www.caitiem.com\/","name":"caitiem.com","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.caitiem.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.caitiem.com\/#\/schema\/person\/0ea20eb328afb663a23dc72ebeced8c0","name":"caiti335","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.caitiem.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/08e6287ee41d891ed906aa45a965ba3c?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/08e6287ee41d891ed906aa45a965ba3c?s=96&d=mm&r=g","caption":"caiti335"},"url":"https:\/\/www.caitiem.com\/author\/caiti335\/"}]}},"_links":{"self":[{"href":"https:\/\/www.caitiem.com\/wp-json\/wp\/v2\/posts\/39"}],"collection":[{"href":"https:\/\/www.caitiem.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.caitiem.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.caitiem.com\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.caitiem.com\/wp-json\/wp\/v2\/comments?post=39"}],"version-history":[{"count":2,"href":"https:\/\/www.caitiem.com\/wp-json\/wp\/v2\/posts\/39\/revisions"}],"predecessor-version":[{"id":47,"href":"https:\/\/www.caitiem.com\/wp-json\/wp\/v2\/posts\/39\/revisions\/47"}],"wp:attachment":[{"href":"https:\/\/www.caitiem.com\/wp-json\/wp\/v2\/media?parent=39"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.caitiem.com\/wp-json\/wp\/v2\/categories?post=39"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.caitiem.com\/wp-json\/wp\/v2\/tags?post=39"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}