Nightlight Conductor Engineering Blog
Введение В наши дни разработка интерфейса является достаточно затратным процессом который требует усилий от множества людей, разработчиков, дизайнеров, тестировщиков продукт менеджеров и так далее. Компании все чаще прибегают к написанию интерфейса состоящего из множества независимых компонентов, которые могут быть ... Read More »
The Power Of Kibana in 6 Simple Steps
At Conductor, our systems generate over 10 million lines of logs every day. On a particularly busy day, we can break 30 million lines. When the DevOps team started using the ELK stack (Elasticsearch, Logstash, and Kibana) to help us ... Read More »
Revamping Continuous Integration and Delivery at Conductor
As companies, products and teams evolve so do development practices. At Conductor we frequently identify areas for opportunity when working on Searchlight. Over the years we have made leaps and bounds in the way we develop, test and deliver high ... Read More »
Using Java 8 Streams to Process Large Amounts of Data
Today, we’re open sourcing an in-house Java 8 stream utility library, which can aggregate, merge, or join streams in a memory efficient way. To skip right to the code, check out the github repo. Here at Conductor, we build Searchlight, a ... Read More »
Bulk ETL from Hadoop to Cassandra
Cassandra’s distributed architecture enables a high write throughput compared to other NoSQL and SQL database systems. Most benchmarks focus on incremental writes, but data can also be efficiently ingested by Cassandra in bulk. Bulk loading is an attractive option when ... Read More »
How to Build a Speedy Custom Compression Codec for Hadoop
What’s Data Compression? Data compression provides a means by which a system can improve I/O performance by shrinking the data being transmitted between stores and processes. Anyone who uses the Internet knows that downloading an immense file takes noticeably longer ... Read More »
Anatomy of a Test Plan
Some organizations do not proceed with a project until they have an agreed-upon test plan. Some organizations write them along the way. And some organizations never get around to thinking about them at all. To start, let’s talk about what ... Read More »
Re-architecting the Sprint Demo for a Growing Engineering Team
This year, Conductor adopted a new method of showcasing engineering accomplishments that promotes interdepartmental communication. Twice a month, we engineers put on our orange t-shirts, and go to the Conductor Café to speak about what our team has worked on ... Read More »
Running a Selenium Grid using Docker and Compose
As an engineer who’s responsible for maintaining an automated testing system for continuous integration, building it and making it reliable can be a challenging and time-consuming venture – but one that ultimately pays off. Conductor Searchlight, Conductor’s content intelligence platform, ... Read More »
A guide to publishing JavaScript open source projects
So you’ve just completed development of your first JavaScript library, and you think it could help the rest of the world. You’ve heard people discuss the “open source movement” or “GitHub profiles,” but you’re still a novice at this whole ... Read More »