Uber Data Model

In this post I will try to come up with a data model which can serve the requirements of ride sharing companies like Uber, Lyft, Ola etc. We will approach the problem as an interview and see how we can come up with a feasible data model by answering important questions.

 Important Entities
The first step towards building a data model is to identify important actors/ entities involved in the process. In our case, if we think about our interaction with taxi apps, we can identify important entities involved. The user (i.e. Rider) is one such entity, so is the Driver/ Partner. Once we open the app, we try to book a trip by finding a suitable taxi/ cab from a particular location to another. After the trip gets finished, the app collects the payment and we are done. Ideally, the flow continues to reviews/ ratings, helpcenter in case of issues etc. but for this post we will only consider scenarios till the ride gets finished. So, to summarize, we have the following key entities;

 Rider
Driver
Cab
Trip
Location
Payment

Attributes
Once we have some sense of the important entities in any scenario, the next step is figure out important attributes for each of these entities. 

 Rider
A record in this table should be about the details for the rider. Apart for the usual demographic attributes, I have added the current payment attributes for any rider. There can be a case for SCD type implementation for these attributes where we have a new record for the rider everytime he changes his payment preferences (while marking the existing record as inactive).

 Driver
Similar to the rider details, we have a table for Drivers which stores demographic attributes. Also, a driver can be driving different vehicles at different points of time. To support that use case, I have a current cab details tagged to the driver record. Again, a case can be made for tracking history of cabs being used by a driver.

 Cab
This table stores details about vehicles onboarded to the platform. As the per km rate of the ride gets defined by the vehicle type, there is an attribute capturing the base_rate.

 Rider_Bookmarks
A rider might want to save some strategic locations to avoid searching on the map (e.g. home, office etc.). This table will store those locations.

 Map_Grid
In order to tag each location on the map to query-able records, we can imagine the map to be a grid (e.g. grids of 1km x 1km). This allows us to query maps data with other tables in our relational schema.

 Location
This table will store locations in the "human readable" form. It has provisions to tag some landmarks (e.g. airports, malls, housing society etc.). It can also serve to identify related/ same locations (e.g. front gate and back gate of a railway station) via the related_location_id field.

 Trip
This table stores details about every trip. It has different timestamp fields which will be of interest while finding durations related to the trip. It also has joins to different tables above for the join queries. 


References:

 https://eng.uber.com/schemaless-part-one/
https://eng.uber.com/schemaless-part-two/

Comments

  1. dreamcareindiaDecember 22, 2020 at 9:56 PM

    such a lovely post!!
    Must have a look at Tips For Setting A Quick, Beautiful Outdoor Table

    ReplyDelete
  2. KamaleshSeptember 22, 2021 at 4:51 AM

    This was a stunning and valuable content. thanks for sharing this informative post.
    Certified Ethical Hacking Course
    Best Ethical Hacking Certification

    ReplyDelete
  3. samDecember 5, 2021 at 4:59 AM

    Thanks for posting this info. I just want to let you know that I just check out your site and I find it very interesting and informative.
    Best PTE institute in ambala
    Best IELTS Institute in Ambala
    Best IELTS Coaching in Ambala

    ReplyDelete
  4. RideAlike April 18, 2022 at 1:46 AM

    Thank you for sharing this article. It will be extremely beneficial to people looking for Uber Data Model on the internet. RideAlike is a car rental company in Toronto. By visiting their website, you can easily book a ride.

    ReplyDelete
  5. moeenApril 29, 2022 at 12:19 AM

    "Taxis in stevensville Maryland
    If you’ve crossed the Chesapeake Bay Bridge, you’ve gone right by Kent Island. Located off the west coast of Queen Anne’s County, Kent Island sits at the base of the Chesapeake Bay Bridge, connecting Maryland’s eastern and western shores. Public transportation through this area is limited, and Annapolis Taxi Cabs can alleviate difficult transportation situations. Annapolis Taxi Cabs offers reliable Taxi Cab Service in stevensvill Maryland."

    ReplyDelete
  6. sophia ashMay 3, 2022 at 11:25 PM

    Excellent tips and blog for sharing such useful information! The Uber app clone can help you get your business on the web. Get a branded and customized app like Uber that has more features.Let's Develop an app like uber to make money in the taxi business with our uber app clone.Thank you so much for sharing all this wonderful Blog!

    ReplyDelete
  7. klausOctober 25, 2024 at 12:18 PM

    By guiding me away from congested areas, connectsmart ensures that I always arrive at my destination promptly. You can understand why ConnectSmart is an essential tool for regular commuters with its real-time traffic reports and alternative route recommendations!

    ReplyDelete

Post a Comment

Popular posts from this blog

Data Engineer Interview Questions: SQL

Image
In this post, I will try to share some actual questions asked by top companies for Data Engineer positions. A lot of these companies will cover data modelling as one of the rounds and will use the data model for the next round based on SQL queries. Q1: Find the number of drivers available for rides in any area at any given point of time. Q2: Do you consider Driver and Rider as separate entities? Why or why not? Q3: Give me all passenger names who used the app for only airport rides. Q4: How will you decide where to apply surge pricing? Q5: How will you calculate wait times for rides? Q6: A driver can ride multiple cars, how will you find out who is driving which car at any moment? Q7: Find out Rank without using any function. Q8: How will you delete duplicates from a table? Q9: How will you find percentile? Q10:  You have 3 tables, user_dim (user_id, account_id), account_dim (account_id, paying_customer), and dload_facts (date, user_id, and downloads), fin...
Read more

Cracking Data Engineering Interviews

Of late, a lot of people have asked me for tips on how to crack Data Engineering interviews at FAANG (Facebook, Amazon, Apple, Netflix, Google) or similar companies. I have not worked at all of these companies so I can't share tips which will necessarily apply for all of them but I will share tips which can be generalized for most of the big companies. First of all, the field of Data Engineering has expanded a lot in the last few years and has become one of the core functions of any big technology company. The obvious reason for this expansion is the amount of data being generated by devices and data-centric economy of the internet age. Each company is focussed on making the best use of data owned by them by making data driven decisions. If you compare this to the Data Engineering roles which used to exist a decade back, you will see a huge change. In the past, Data Engineering was invariably focussed on Databases and SQL. Even now, these two form some part of most Data Engin...
Read more

Hive Challenges: Bucketing, Bloom Filters and More

In the second post of this series, we will learn about few more aspects of table design in Hive. Now that you know about partitioning challenges , you will be able to appreciate these features which will help you to further tune your Hive tables. Bucketing In addition to Partitioning the tables, you can enable another layer of bucketing of data based on some attribute value by using the Clustering method. Clustering can be used with partitioned or non-partitioned hive tables. One particular use case where Clustering becomes useful when your partitions might have unequal number of records (e.g. users logging in per country, US partition might be a lot bigger than New Zealand). In such cases, you can define the number of buckets and the clustered by field (like user Id), so that all the buckets have equal records. In partitioning each partition gets a directory while in Clustering, each bucket gets a file. Records with the same bucketed column will always be stored in the same bucke...
Read more

UBER Data Architecture

Image
In this post, I will try to cover the data architecture Uber has built to support their big data applications. This should be applicable for other ride hailing apps as well. There are multiple modules at play here so I will try to give a brief overview along with a detailed discussion on the data architecture.  An aeroplane view of the problem tells us that effectively we are trying to solve a demand vs. supply problem. All the Drivers active at any point of time constitute the supply while all the cab requesters (Riders) form the demand. What Uber tries to do is to have the best matching between demand and supply "at any point at any moment". I have highlighted the location and temporal conditions as they are critical for the success of what Uber tries to do. Let's get started to see how Uber comes around these challenges by creating a scalable data architecture. Every Driver active on Uber keeps sending his location data to the server (e.g. every 5 seconds). T...
Read more