Spotify R&D

I mentioned this in the Swimm + RVO Health + Backstage from Spotify Webinar yesterday: Get DX has released a plugin for Backstage! Please go check it out: https://lnkd.in/eqhPtJgG 🚀

Exciting news! ✨ U.S. News & World Report has announced the 2024-2025 U.S. News Best Companies to Work For. How did we do? Not bad at all. Spotify is on not one but two lists: “Best in Media'' and "Best Overall". Thank you to all our incredible bandmates – you rock our world! 💚 #lifeatspotify

Take a deeper dive into Spotify's data Platform in part II of our Data Platform Explained series: https://lnkd.in/eB3cyiNf #data

Tune in to the #DPE Showdown to hear from Helen Greul, Head of Engineering for Backstage at Spotify!

Great example of being open to learn from failures. I still remember the 10k incident that happened in my organisation.

The Fixed-Power Design "is particularly advantageous in environments like Spotify, where the user base is diverse and constantly changing." To read more about Fixed Power Designs, read Mårten Schultzberg's latest post on the Spotify Engineering Blog: https://lnkd.in/eRAbmzcF #experimentation

Calling all platform engineers! Join us for Cloud Native Live: "Building a Secure, Reliable, Observable IDP with Backstage and Linkerd." In this session, Backstage maintainer Ben Lambert and Linkerd Tech Evangelist Flynn will demo a proof-of-concept Backstage plugin for Linkerd that lets Backstage automatically learn cross-service dependencies based on actual traffic within your application. Come and learn how to use a service mesh for better observability and a smoother developer experience. Get ready for expert insights, demos, and a live Q&A – register now and don't miss out! #OpenSource #CloudNative #Linkerd #Backstage

Did you miss KubeCrash last week? If so, you missed a lot of great content on Internal Developer Platforms (IDPs). But don't worry. The talks were recorded, and we'll be posting them here, one by one. First up is the keynote by Spotify R&D Sr. Software Engineer Vincenzo Scamporlino on Scaling the Stage: Managing 200+ Plugins & Thousands of Engineers. A crucial step for building a developer portal on top of Backstage involves the integration of Open Source plugins or the development of custom plugins. As the number of these plugins grows, one realizes that all the plugins will run in the same instance, potentially leading to limitations typical of monolithic applications. However, according to the official documentation, this seems to be the way to go. This talk explores how the largest Backstage adopters managed to scale their instances to handle the load imposed by thousands of engineers. The session delves into an in-depth analysis of the internal architecture of Spotify's Backstage, uncovering how Spotify has successfully scaled an internal instance with over 200 plugins, effectively managing the daily demands of thousands of engineers. Additionally, the presentation offers insights into different approaches to scaling out Backstage, providing attendees with guidance to identify the best-fit method for their respective use cases. #CloudNative #OpenSource #Conference #Kubernetes

Happy to share our latest blog post of our research paper "In-context Exploration-Exploitation for Reinforcement Learning", which will be presented at ICLR 2024 this week. This paper studies the exploration/exploitation behavior in in-context learning, which enables Bayesian decision making through neural network inference. Work from Zhenwen Dai, Federico Tomasi and Sina Ghiassian. The poster of this paper will be presented on May 9th at Hall B #168. #machinelearning #ml #reinforcementlearning

Are you using or thinking about using an internal developer portal? If so, take a look 👇