Blueprint Series: Data Engineering in Badoo, handling 20 billion events per day

Every day Badoo family projects users generate billions of events. Making sense of all that data is no small feat. Find out about tools and approaches we use to deliver, store, process and explore data in a unified way across all of our projects and brands. Speaker: Vladimir Kazanov, Data...

Blueprint Series: Achieve 100% Analytics Adoption with a New Class of Enterprise Intelligence

Despite having access to a wealth of data, organisations still struggle to effectively deliver trusted insights to the entire workforce—preventing them from realizing the full value of their data investments. Overcoming this challenge takes pervasive adoption of trusted analytics. This talk will cover: • Empowering business users with self-service analytics...

Blueprint Series: The Data Landscape at Monsoon/Accessorize

This talk will cover Monsoon’s recent project to replace their BI stack. It will detail what the tech stack looked like previously and the business requirements that the project needed to fulfil to deem it a success. Then Jon will cover the migration and the benefits achieved and then conclude...

MEETUP 13th June: Blueprint Series, Intelligent Engineering – Making sense of BIG data

The Big Data LDN Meetup group is continuing the Blueprint Series of data architecture meetups. On Thursday 13th June from 6:30pm, Skills Matter hosts the Blueprint Series, Intelligent Engineering – Making sense of BIG data TALK 1: Data Engineering in Badoo: handling 20 billion events per day Synopsis: Every day...

Blueprint Series: Speed Up Your Apache Cassandra Applications – A Practical Guide to Reactive Programming

Speaker: Cedrick Lunven, Developer Advocate, DataStax Speaker Bio: Cedrick is a Developer Advocate at DataStax where he finds opportunities to share his passions by speaking about developing distributed architectures and implementing reference applications for developers. In 2013, he created FF4j, an open source framework for Feature Toggle which he still...

Blueprint Series: Inextricably Linked – Reproducibility and Productivity in Machine Learning

Speaker: Mark Coleman, VP Marketing at dotscience and Marketing Chairperson for Cloud Native Computing Foundation. Talk Synopsis: Because it is more complex and has far more moving parts, machine learning is where Software Development was in 1999: people are emailing and Slacking notebooks to each other, due to a lack...

Blueprint Series: Banking in the Cloud – Ultra-High Reliability Architectures

Data architecture for a challenger bank. Speaker: Jason Maude, Head of Technology Advocacy, Starling Bank Speaker Bio: Jason Maude is a coder, coach, and public speaker. He has over a decade of experience working in the financial sector, primarily in creating and delivering software. He is passionate about explaining complex...

Blueprint Series: A Platform for Freedom & Governance in the Cloud

Any enterprise seeking to create value from data has two conflicting and divergent objectives. On the one hand, cohorts of users and developers need to access data from multiple sources, to create analytics, dashboards, reports and apps. On the other hand, a responsible enterprise must secure, govern and define data...

Blueprint Series: Achieving Governance, Agility & Reduced Time to Value In An Increasingly Complex Data Landscape

In most organisations, the demand to analyse data continues to grow exponentially. New data from many new data sources are now being captured and new types of data stores are being created on multiple clouds as well as on-premise data centres. The result is that the data landscape is becoming...

Blueprint Series: Expedia Partner Solutions, Data Platform

Join Anselmo for an engaging overview of the new end-to-end data architecture at Expedia Group, taking a journey through cloud and on-prem data lakes, real-time and batch processes and streamlined access for data producers and consumers. Find out how the new architecture unifies a complex mix of data sources and...

Blueprint Series: Architecture Patterns for Implementing Serverless Microservices & Stream Processing

Join Richard who will talk about how the data science team at JustGiving built KOALA, a fully serverless stack for real-time web analytics capture, stream processing, metrics API, and storage service, supporting live data at scale from over 26M users. He will discuss recent advances in serverless computing, and how...

Blueprint Series: Engaging the people-power that underpins your data architecture

‘The importance of the ‘why’ behind what you do’ – Engaging the people-power that underpins your data architecture. Speaker: James Adams, Practice Lead – Workforce planning, Eden Smith. Filmed at Skills Matter/Code Node London on 14th March 2019 as part of the Big Data LDN Meetup Blueprint Series. Meetup sponsored...

Blueprint Series: Expedia Partner Solutions, Data Platform

Big Data LDN Meetup: The Blueprint Series – 14th March 2019 Join Anselmo for an engaging overview of the new end-to-end data architecture at Expedia Group, taking a journey through cloud and on-prem data lakes, real-time and batch processes and streamlined access for data producers and consumers. Find out how...

Blueprint Series: Architecture Patterns for Implementing Serverless Microservices & Stream Processing

Big Data LDN Meetup: The Blueprint Series – 14th March 2019 Richard Freeman talks about how the data science team at JustGiving built KOALA, a fully serverless stack for real-time web analytics capture, stream processing, metrics API, and storage service, supporting live data at scale from over 26M users. He...

How to manage IoT data?

The accelerated growth of the Internet of Things (IoT) is responsible for generating huge amounts of data, as many consumer, in-home and industrial devices are being embedded with software and sensors that gather virtual information, which is then transmitted to an internal hub via network connectivity. With such huge amounts...

OVERCOME BY EVENTS – APACHE KAFKA AND EVENT-ORIENTED ARCHITECTURE

In this talk, Jay Kreps will explain why the Military term ‘Overcome by Events’ or OBE can now be applied to systems – as they are being overrun by events. Confluent’s CEO will also discuss Event Oriented Architecture and how is it affecting the systems we build and scalability of...

FORTUNE 100 LESSONS ON ARCHITECTING DATA LAKES FOR REAL-TIME ANALYTICS

OVERCOME BY EVENTS: APACHE KAFKA AND EVENT-ORIENTED ARCHITECTURE

In this talk, Jay Kreps will explain why the Military term ‘Overcome by Events’ or OBE can now be applied to systems – as they are being overrun by events. Confluent’s CEO will also discuss Event Oriented Architecture and how is it affecting the systems we build and scalability of...

CHARTING ZERO LATENCY FUTURE WITH REDIS

Five stars: the ingredients for a digital revolution

Slow and steady doesn’t always win – sometimes revolutionary thinking is needed for a dramatic upheaval. We are experiencing huge changes in the digital world, both in industry-wide technology “uprisings” such as artificial intelligence and edge computing, and from innumerable internal digital transformation projects where the revolutionary spark is catching...

The Legacy of Technology

Information Technology (IT) has evolved over the last three decades from a few punch cards, to a few computers, and now to entire networks of computers. But how has this rapid expansion of technology affected business over the years? For one thing: there are now hundreds, if not thousands, of...

ERP data access: 5 top tips

One of the most-read blogs on the ZAP website is a piece I wrote earlier this year with advice for successful ERP data access. This will undoubtedly be a hot topic at Big Data LDN but, with so much great information coming out of the event, I’ll cut to the...

Hybrid Optimal Processing Environment – HOPE for us all?

In a world seemingly threatened by AI and RPA (not to mention acronyms in general..), it is reassuring to step back and look at the reality. Whilst many mundane tasks can be automated using so-called ‘bots’, the requirement for human intervention still exists and should not be underestimated. At the...

Hadoop and Spark – what are the differences?

Hadoop and Spark are the two main infrastructure framework available to store and process all of your big data. When Spark emerged in 2014, many predicted it would overtake Hadoop as the leading service, but the two both remain widely used. The biggest reason for this is the huge differences...

What is data wrangling?

Businesses of the modern age generate huge amounts of data every day and the data gathered continues to grow as more channels for accumulating information emerge. It is becoming increasingly important for businesses to organise and utilise the invaluable tool that is data and data wrangling can support this. In...

Why isn’t your business using NoSQL databases yet?

Businesses today are collecting huge amount of data every single day that can be used to benefit the business and its operations. The sheer volume of data that companies now deal with and store on a daily basis means that traditional frameworks are under pressure and in some cases are...