OTTO – CI/CD

“When we decided to use Talend, we also decided to build a completely new data lake on our Cloudera cluster”, says van Ryswyk. OTTO saw Talend acting as the bridge between the new data lake — which stores data from the OTTO website and from partner websites — and the company’s 250TB Exasol database. “We also knew that one of the advantages of using a solution like Talend would be simplified software maintenance. Like many other companies, we had a lot of integration scripts we could no longer maintain because the original developers were no longer here. So Talend is ideal for standardizing integration when you’re building a new data lake from scratch.”

“Also, Talend gave us the option to use our own CI/CD process, which none of the competing solutions did,” says Rouven Homann, Management Partner at cimt ag, OTTO’s IT consultant. “With CI/CD, we can continuously integrate data sources using Talend and continuously develop and deliver new, small upgrades, updates, and applications,” says van Ryswyk. “That means we can deliver requested functionality, make changes and correct issues much faster, and just overall reduce the risks associated with developing new software and putting it into production.”

Homann adds that the CI/CD strategy has also improved the quality of the software released. “We’ve established best practices for all Talend jobs,” he says. “We’ve created test environments, processes, and everything a developer needs to put new software into production much faster.”