Most companies struggle to build a single source of truth for every interaction with their customers because they have data siloed in scores of different tools. Often, they don’t realize the full extent of an engineering investment to bring all of their data together until they embark on an infamous “data lake” project. Not anymore.
Segment receives billions of events from our customers daily and has grown in to dozens of AWS accounts. Expanding in to many more accounts was necessary in order to best align with our GDPR and security initiatives, but it comes at a large complexity cost. In order to continue scaling gracefully we are investing in building tooling for employees to use with many accounts, and…
This post is a guest submission by one of our customers and friends at InVision. The InVision team’s clever use of Segment, combined with our partners ClearBrain and Clearbit, has led to some pretty advanced programmatic predictive models. We’re grateful they took the time to share how they did it in this writeup.
Go has a robust built-in testing library. If you write Go, you already know this. In this post we will discuss a handful of strategies to level up your Go testing. We have learned from experience on our large Go codebase that these strategies work to save time and effort maintaining the code.
Elevated carbon dioxide impairs decision making. And it doesn’t take a lot of carbon dioxide either! Normal atmospheric carbon dioxide has risen from 280 ppm to 415 ppm in the past century, but in poorly ventilated buildings and stuffy meeting rooms, concentrations can easily get into the thousands of ppm. Unfortunately, above 1000 ppm there’s a substantial and measurable…
Your customers expect you to remember who they are, no matter where they interact with your company — whether through your mobile app, website, emails, ads, push notifications, live chats, in-store, or the support and sales team. To them, you are one brand, one company, and they are one person. They should be treated like one, and each conversation you have with them, no…
It’s not hyperbole to say that Segment would not exist, if not for open source. We’re heavy users of Kafka, Redis, Terraform, Docker, Golang, and Node.js, just to name a few of the tools we use. And we literally got our start as an open source library launched on Hacker News.
Memory management can be tricky, to say the least. However, after reading the literature, one might be led to believe that all the problems are solved: sophisticated automated systems that manage the lifecycle of memory allocation free us from these burdens.
The way companies manage application secrets is critical. Even today, improper secrets management has resulted in an astonishing number of high profile breaches.
Today we’re excited to open source the various pieces of our logging pipeline. We’ve released a rate-limiting-syslog proxy, a journald fanout service, and a cloudwatch logs CLI. To understand how they work in concert, read on.
Analytics insights are useless if they’re locked away in your BI platform.
Today we’re rolling out a major update to the Segment app, designed to clarify how your data flows through Segment.
We’re excited to share that Segment has raised $64 million in Series C funding, led by Y Combinator Continuity and joined by GV. Our existing investors at Accel, Thrive, NEA, and Ron Conway’s SV Angel also participated.
The single requirement of all data pipelines is that they cannot lose data. Data can usually be delayed or re-ordered–but never dropped.
Today we’re releasing ksuid, a Golang library for unique ID generation. It borrows core ideas from the ubiquitous UUID standard, adding time-based ordering and more friendly representation formats. In doing the research that went into this library, we uncovered a compelling story that we wanted to share with a larger audience.
Today we’re launching Cross-Domain Analytics to help you understand how users browse across all your domains. We built Cross-Domain Analytics as an alternative to existing systems like Liveramp and BlueKai which use third-party cookies to tie users across domains. These are not only lossy by nature, but fundamentally violate users’ privacy by following them as they browse the…
At Segment we pride ourselves on being data-driven. Wherever we can use data to solve or surface problems, we do. Among other things, we use surveys to measure our engagement, motivation, happiness and ability to focus.
Recently we shared the techniques we used to save more than a million dollars annually on our AWS bill. While we went into detail about the various problems and solutions, the most common question we heard was: "I know I’m spending a ton on AWS, but how do I actually break that into understandable pieces?"
In a scrappy B2B startup, user feedback is super valuable, but guerrilla research won’t cut it when you need a more targeted group of users. The Segment Design team found the users we needed and developed an automated process for recruitment and coordinating interviews using our own product and a few integrated applications.
Each year on April 22, Earth Day marks the anniversary of the modern environmental movement born in 1970. Just a few years shy of its 50th anniversary, this Earth Day sees today’s outlook on environmental protection, awareness, and progress in a troubling state.
The barrier holding back most open source projects is surprisingly mundane. It’s not test coverage. It’s not performance. It’s not code quality.
Running QA tests for Segment’s UI was taking way too long. Sure, we had strong component-level tests for our UI kit. But to test our whole app we needed to painstakingly poke around looking for oddities.
Today we’re proud to announce the Segment Open Fellowship. The Fellowship is a three month long program supporting three to five open-source developers with $8k per month to focus full-time on their project, no other strings attached.
For an early startup, using the cloud isn’t even a question these days. No RFPs, provisioning orders, or physical shipments of servers. Just the promise of getting up and running on “infinitely scalable” compute power within minutes.