Systems and methods for managing data at a gateway device receiving sensor data is discussed. An in-memory persistent database can provide a common application programming interface (API) for pushing data from one or more drivers that receive sensor data over various communication protocols. The common API can also be utilized by a data sender application to pull data from the in-memory persistent database and send the pulled data to a remote server such as a cloud storage. The in-memory persistent database stores the sensor data in time ordered pipeline data structures. A configuration data structure is maintained for each set of sensors and can be accessed and modified using the common API.