Alpha Testing: log.reader... web-based dynamic graphing
Thread Starter
Evolved Member
iTrader: (38)
Joined: Nov 2006
Posts: 1,745
Likes: 10
From: New Hampshire, USA
Alpha Testing: log.reader... web-based dynamic graphing
I've begun creating the framework to allow someone to upload an EvoScan .CSV file to my webserver, and have the information parsed into a database.
The basics of the framework are now working, to the point where you can upload a log and view the data as a dynamically generated graph, using PHP, GD, and MySQL.
To see for yourself, upload some logs and play around with the graphs by visiting:You can also play with an already uploaded log by visiting this link and picking from the "Select a log element" drop-down: Note, these graphs are images and can be linked using the URL displayed below the graph.
The ultimate goal of this project is pretty ambitious... having log data in a web-accessible database means the possibilities are infinite.
Current Features
* Upload .CSV log files & store in database
* Display log data in dynamically graphed image
* Resize graphed image as you see fit
* Clip graph data to remove dead spots (no log data, unrealistic data, etc)
* Limit graph to smaller, user-specified portion of log
* Customizable colors & line weights
Planned Features
* Customizable axes and legends
* Multiple data elements drawn on one graph
* Multiple logs drawn on one graph
* Customizable X-axis, such as RPM
* Quarter mile estimator, based on multiple elements and real quarter mile log comparisons
* Fully user-customizable analytics to allow users to code their own functions to get quick feedback on log data. For example, I could write a series of algorithms that summarize good or bad things about the log, and make logical suggestions as to why and how to fix it.
* Integration with EcuFlash ROM images for map tracing and other cross-referencing functions
* ... and anything else you guys can think of!
Known Bugs
* Logs with over 1024 samples will be truncated after 1024
Bug Fixes
* Fixed more upload bugs (11/30/07)
* Fixed Internet Explorer upload bug (10/18/07)
* Fixed bug in log elements not appearing in viewable list (10/18/07)
* Fixed bug preventing some machines from uploading logs (11/05/07)
Here are a few graphs which pull from some of my test logs in the database:

The basics of the framework are now working, to the point where you can upload a log and view the data as a dynamically generated graph, using PHP, GD, and MySQL.
To see for yourself, upload some logs and play around with the graphs by visiting:You can also play with an already uploaded log by visiting this link and picking from the "Select a log element" drop-down: Note, these graphs are images and can be linked using the URL displayed below the graph.
The ultimate goal of this project is pretty ambitious... having log data in a web-accessible database means the possibilities are infinite.
Current Features
* Upload .CSV log files & store in database
* Display log data in dynamically graphed image
* Resize graphed image as you see fit
* Clip graph data to remove dead spots (no log data, unrealistic data, etc)
* Limit graph to smaller, user-specified portion of log
* Customizable colors & line weights
Planned Features
* Customizable axes and legends
* Multiple data elements drawn on one graph
* Multiple logs drawn on one graph
* Customizable X-axis, such as RPM
* Quarter mile estimator, based on multiple elements and real quarter mile log comparisons
* Fully user-customizable analytics to allow users to code their own functions to get quick feedback on log data. For example, I could write a series of algorithms that summarize good or bad things about the log, and make logical suggestions as to why and how to fix it.
* Integration with EcuFlash ROM images for map tracing and other cross-referencing functions
* ... and anything else you guys can think of!
Known Bugs
* Logs with over 1024 samples will be truncated after 1024
Bug Fixes
* Fixed more upload bugs (11/30/07)
* Fixed Internet Explorer upload bug (10/18/07)
* Fixed bug in log elements not appearing in viewable list (10/18/07)
* Fixed bug preventing some machines from uploading logs (11/05/07)
Here are a few graphs which pull from some of my test logs in the database:
Last edited by recompile; Dec 1, 2007 at 04:05 AM.
I think thats a great idea for a project.
I uploaded a map to test it out. It would be cool if you could graph more than one item at a time on the same plot. And also have the ability to select a range of points to graph if you don't need to show the entire log.
I uploaded a map to test it out. It would be cool if you could graph more than one item at a time on the same plot. And also have the ability to select a range of points to graph if you don't need to show the entire log.
Thread Starter
Evolved Member
iTrader: (38)
Joined: Nov 2006
Posts: 1,745
Likes: 10
From: New Hampshire, USA
Edit: I've gone ahead and added "Start" and "End" fields to allow you to shrink the graph to a specific part of the log. I also renamed "Min" and "Max" to "Clip Low" and "Clip High". All data out of that range is ignored.
Last edited by recompile; Oct 13, 2007 at 12:02 PM.
Cool idea, organization and fleshing it out will be key.
If you could get detailed setup information with each log. (kinda like a log submission form to fill out that populates with the log) You could really archive some useful information for comparison that would be extremely beneficial for all.
Integrating a trace mode for your own rom image and settings would be cool. If it was functional as to suggest good solutions... some of these guys making a living selling flashes might be sol.
It could be huge if you had the dedication to see it thru.
I hope you do.
If you could get detailed setup information with each log. (kinda like a log submission form to fill out that populates with the log) You could really archive some useful information for comparison that would be extremely beneficial for all.
Integrating a trace mode for your own rom image and settings would be cool. If it was functional as to suggest good solutions... some of these guys making a living selling flashes might be sol.
It could be huge if you had the dedication to see it thru.
I hope you do.
Trending Topics
Thread Starter
Evolved Member
iTrader: (38)
Joined: Nov 2006
Posts: 1,745
Likes: 10
From: New Hampshire, USA
Like paste this:
C:\Program Files\EvoScan\v0.90\SavedDataLogs\YourLog.csv
Account Disabled
iTrader: (38)
Joined: Aug 2005
Posts: 9,319
Likes: 1
From: Virginia Beach, Virginia
neat project, once you can graph multiple items simultaneous you'll have a hit
rpm, tps, knock, timing, 02 etc...
also the ability to overlay two runs on top of each other would be cool.
rpm, tps, knock, timing, 02 etc...
also the ability to overlay two runs on top of each other would be cool.
Thread Starter
Evolved Member
iTrader: (38)
Joined: Nov 2006
Posts: 1,745
Likes: 10
From: New Hampshire, USA
I fixed an upload bug that caused it to hang and not move past "Please wait..."
I will be working towards new features and bug fixes this weekend. There is currently a bug in which it will only take in the first 1024 lines of your log, so for people that have really long logs, it isn't working 100% right now.
Let me know if anyone has problems or feature requests.
I will be working towards new features and bug fixes this weekend. There is currently a bug in which it will only take in the first 1024 lines of your log, so for people that have really long logs, it isn't working 100% right now.
Let me know if anyone has problems or feature requests.






