[Utopian-data] Python Tool integrated with MongoDB database for Utopian related data collection.

View this thread on: d.buzz | hive.blog | peakd.com | ecency.com
·@jestemkioskiem·
0.000 HBD
[Utopian-data] Python Tool integrated with MongoDB database for Utopian related data collection.
![img.jpg](https://steemitimages.com/0x0/https://i.imgur.com/GNfrhVI.jpg)
[source](https://steemit.com/utopian-io/@vitruvianman/cinematic-intro-for-utopian-io-or-adobe-after-effect-and-premiere)
# Utopian-data
[github repository](https://github.com/utopian-io/utopian-data)
##### What is the project about?

This tool uses https://api.steemit.com and [https://api.utopian.io/](https://api.utopian.io/api/stats) as well as coinmarketcap to fetch all the interesting Utopian related data that could in future be tied to it's growth and properly analyzed.  It was created out of curiosity, but per demand of @wehmoen has now been rewritten to handle more data with a better database (MongoDB over SQLite), as well as save more data than just liquid steem value of all Utopian accounts. As such, the code is now a part of the official Utopian-io company on Github.

Furthermore, the code is easily editable and can be a baseline for any API to Database crawler. The database can also easily be switched (to MySQL for example) by just replacing 2 functions. 

###### This tool currently tracks the following data:
* General stats

![image.png](https://res.cloudinary.com/hpiynhbhq/image/upload/v1518970809/w64gj5qcvbsygghlfr2f.png)

* Income (in steem & delegations) of all Utopian accounts

![image.png](https://res.cloudinary.com/hpiynhbhq/image/upload/v1518970902/ip1ejpfx7o1nnkevopc7.png)

* Category specific stats

![image.png](https://res.cloudinary.com/hpiynhbhq/image/upload/v1518970951/epy382qgewhi2smfhcyw.png)

This project is soon to be developed further, making the data visible for everyone over at https://utopian.info, thanks to @wehmoen who will (hopefully after talking to our boss) let me use Utopian servers for this project. If not, the income from this post will go towards the server fund.

##### Technology Stack

* MongoDB
* Python 3.6

The github repository contains a `requirements.txt` file that can be used to install necessary python libraries with pip.

##### Roadmap

* The project will receive a web interface that allows for viewing any data stored in the utopian_data MongoDB function.
* The project will possibly switch to MySQL so a more broad open-source audience can modify it for their needs.

###### How to contribute?
You can contribute by Pull Requests on the official Github repository. You can also contact me on Discord at Jestemkioskiem#5566 to ask questions about this project and/or the code.
    

<br /><hr/><em>Posted on <a href="https://utopian.io/utopian-io/@jestemkioskiem/utopian-data-python-tool-integrated-with-mongodb-database-for-utopian-related-data-collection">Utopian.io -  Rewarding Open Source Contributors</a></em><hr/>
👍 , , , , , , , , , , , , , , , , , , , , , , , ,