Table of contents
I’m 100% sure anyone who came across this post once had to deal with data analysis somehow. Mostly - with tables and tons of records there.
I personally deal with them all the time, not just because I work in a company that develops pivot grids but in a routine - schedules, contact lists, different statistics in social media, and so on. And I really like it!
Though sometimes it can be so devastating and irritating. When you know what you want to find and where to search but spend minutes simply waiting to filter or sort all the records, it discourages any desire to continue working and throws you off.
This happens so often that the stereotype that working with big data is always an irritating process and takes a lot of time has already formed in our society.
But my team believes the work should be enjoyable! That’s why, some time ago, we set ourselves the task of creating a simple, fast and convenient data grid for our users and us.
Our goal was to:
take away all those struggles,
give you a fast, convenient solution,
and finally, break the myth about boring and time-consuming analysis.
Based on already widely used tools and ideas, we developed a new approach that implements complex algorithms under the hood to work smoothly and fast. And the result was quickly implemented in our new product DataTable.dev!
How did we come to the idea of the product?
Data processing and visualization consist of several main stages:
- data loading,
- its analysis (sorting, filtering, searching),
- and the display on the grid itself.
For all these processes not to overlap, interrupt or delay each other, we developed a unique approach where all the frames have a specific strict structure and time length, along with the correct distribution of time and the optimized sequence of events on the grid, it looks like a high-speed and smooth loading of data.
We calculated many aspects - from the fastest way to transfer data to the most beneficial frame length from a psychological point of view.
Result?
The speed is evident in all grid’s features - scrolling, searching, sorting, and filtering. All actions have an instant result, which subconsciously encourages users to continue analyzing - because it is so simple, fast, and pleasant!
We have been working on this idea and its implementation for almost a year, and today we are happy to show it to the world! Finally, you can learn more about us, read and support the idea on the Product Hunt and visit our new site!
Test demo!
This is a demo version of our product, but we were so eager to hear your thoughts on it and get feedback for further development and improvement that we decided to launch this concept early.
In the demo, you can see a processed 1.5 GB file with 11 million rows displayed instantly. Scroll, filter, sort, or search for a particular record - our approach allows us to do that in a matter of seconds.
For now, you can touch the handles and check the operation of the product on the site. There you will find a more detailed description of the functionality and a little about the inner kitchen of our approach.
I look forward to your comments and ideas under the post and in our form on the site. Share how, where, and why you would use DataTable.dev. What could be added to it? Or maybe you have some criticism about it? We will gladly read all your suggestions and continue to improve our invention for a full release into the world!