Notices
ECU Flash

Alpha Testing: log.reader... web-based dynamic graphing

Thread Tools
 
Search this Thread
 
Old Oct 13, 2007 | 06:05 AM
  #1  
recompile's Avatar
Thread Starter
Evolved Member
iTrader: (38)
 
Joined: Nov 2006
Posts: 1,745
Likes: 10
From: New Hampshire, USA
Alpha Testing: log.reader... web-based dynamic graphing

I've begun creating the framework to allow someone to upload an EvoScan .CSV file to my webserver, and have the information parsed into a database.

The basics of the framework are now working, to the point where you can upload a log and view the data as a dynamically generated graph, using PHP, GD, and MySQL.

To see for yourself, upload some logs and play around with the graphs by visiting:You can also play with an already uploaded log by visiting this link and picking from the "Select a log element" drop-down: Note, these graphs are images and can be linked using the URL displayed below the graph.

The ultimate goal of this project is pretty ambitious... having log data in a web-accessible database means the possibilities are infinite.

Current Features
* Upload .CSV log files & store in database
* Display log data in dynamically graphed image
* Resize graphed image as you see fit
* Clip graph data to remove dead spots (no log data, unrealistic data, etc)
* Limit graph to smaller, user-specified portion of log
* Customizable colors & line weights

Planned Features
* Customizable axes and legends
* Multiple data elements drawn on one graph
* Multiple logs drawn on one graph
* Customizable X-axis, such as RPM
* Quarter mile estimator, based on multiple elements and real quarter mile log comparisons
* Fully user-customizable analytics to allow users to code their own functions to get quick feedback on log data. For example, I could write a series of algorithms that summarize good or bad things about the log, and make logical suggestions as to why and how to fix it.
* Integration with EcuFlash ROM images for map tracing and other cross-referencing functions
* ... and anything else you guys can think of!

Known Bugs
* Logs with over 1024 samples will be truncated after 1024

Bug Fixes
* Fixed more upload bugs (11/30/07)
* Fixed Internet Explorer upload bug (10/18/07)
* Fixed bug in log elements not appearing in viewable list (10/18/07)
* Fixed bug preventing some machines from uploading logs (11/05/07)

Here are a few graphs which pull from some of my test logs in the database:




Last edited by recompile; Dec 1, 2007 at 04:05 AM.
Reply
Old Oct 13, 2007 | 10:43 AM
  #2  
dudical26's Avatar
Evolved Member
iTrader: (17)
 
Joined: Nov 2005
Posts: 2,544
Likes: 0
From: NNJ
I think thats a great idea for a project.

I uploaded a map to test it out. It would be cool if you could graph more than one item at a time on the same plot. And also have the ability to select a range of points to graph if you don't need to show the entire log.
Reply
Old Oct 13, 2007 | 11:42 AM
  #3  
recompile's Avatar
Thread Starter
Evolved Member
iTrader: (38)
 
Joined: Nov 2006
Posts: 1,745
Likes: 10
From: New Hampshire, USA
Originally Posted by dudical26
I think thats a great idea for a project.

I uploaded a map to test it out. It would be cool if you could graph more than one item at a time on the same plot. And also have the ability to select a range of points to graph if you don't need to show the entire log.
Thanks for the help testing.

Edit: I've gone ahead and added "Start" and "End" fields to allow you to shrink the graph to a specific part of the log. I also renamed "Min" and "Max" to "Clip Low" and "Clip High". All data out of that range is ignored.

Last edited by recompile; Oct 13, 2007 at 12:02 PM.
Reply
Old Oct 13, 2007 | 11:48 AM
  #4  
recompile's Avatar
Thread Starter
Evolved Member
iTrader: (38)
 
Joined: Nov 2006
Posts: 1,745
Likes: 10
From: New Hampshire, USA
Here's a few from the log you uploaded:







Reply
Old Oct 13, 2007 | 03:43 PM
  #5  
RazorLab's Avatar
EvoM Guru
20 Year Member
Liked
Loved
Community Favorite
iTrader: (8)
 
Joined: Aug 2003
Posts: 14,092
Likes: 1,090
From: Mid-Hudson, NY
Very cool stuff. Web-based tuning anyone?
Reply
Old Oct 13, 2007 | 08:26 PM
  #6  
Asmodeus6's Avatar
Evolved Member
iTrader: (7)
 
Joined: Nov 2006
Posts: 772
Likes: 0
From: Pittsburgh
Cool idea, organization and fleshing it out will be key.

If you could get detailed setup information with each log. (kinda like a log submission form to fill out that populates with the log) You could really archive some useful information for comparison that would be extremely beneficial for all.

Integrating a trace mode for your own rom image and settings would be cool. If it was functional as to suggest good solutions... some of these guys making a living selling flashes might be sol.

It could be huge if you had the dedication to see it thru.
I hope you do.
Reply
Old Oct 14, 2007 | 10:20 AM
  #7  
dudical26's Avatar
Evolved Member
iTrader: (17)
 
Joined: Nov 2005
Posts: 2,544
Likes: 0
From: NNJ
shamless - I like the revisions, nice going.
Reply
Old Oct 15, 2007 | 08:46 AM
  #8  
fastrob691's Avatar
Evolving Member
iTrader: (9)
 
Joined: Feb 2006
Posts: 444
Likes: 0
From: willcox, az
I have Vista and when I go to the browse spot, I open my saveddatalogs folder in evoscan and it wont show any csv files? Any ideas, it opens fine from works spreadsheet.
Reply
Old Oct 15, 2007 | 09:42 AM
  #9  
merkzu's Avatar
Evolving Member
iTrader: (4)
 
Joined: Dec 2006
Posts: 392
Likes: 1
From: Twin Cities, MN
see if there's a "compatibility files" button on the file browser, I have to use that to see evoscan logs
Reply
Old Oct 15, 2007 | 10:13 AM
  #10  
fastrob691's Avatar
Evolving Member
iTrader: (9)
 
Joined: Feb 2006
Posts: 444
Likes: 0
From: willcox, az
I saw that compatablity files on the browser from the windows side, but not when I try and upload through the site, I'm sure its something simple.
Reply
Old Oct 15, 2007 | 12:20 PM
  #11  
recompile's Avatar
Thread Starter
Evolved Member
iTrader: (38)
 
Joined: Nov 2006
Posts: 1,745
Likes: 10
From: New Hampshire, USA
Originally Posted by fastrob691
I have Vista and when I go to the browse spot, I open my saveddatalogs folder in evoscan and it wont show any csv files? Any ideas, it opens fine from works spreadsheet.
Will it let you paste the path to the file in the box instead of browsing to it?

Like paste this:

C:\Program Files\EvoScan\v0.90\SavedDataLogs\YourLog.csv
Reply
Old Oct 15, 2007 | 01:26 PM
  #12  
Mellon Racing's Avatar
Account Disabled
iTrader: (38)
 
Joined: Aug 2005
Posts: 9,319
Likes: 1
From: Virginia Beach, Virginia
neat project, once you can graph multiple items simultaneous you'll have a hit

rpm, tps, knock, timing, 02 etc...


also the ability to overlay two runs on top of each other would be cool.
Reply
Old Oct 15, 2007 | 03:30 PM
  #13  
fastrob691's Avatar
Evolving Member
iTrader: (9)
 
Joined: Feb 2006
Posts: 444
Likes: 0
From: willcox, az
Originally Posted by ShamelessCookie
Will it let you paste the path to the file in the box instead of browsing to it?

Like paste this:

C:\Program Files\EvoScan\v0.90\SavedDataLogs\YourLog.csv
Ill try it when I get in tonight, Vista has a few quirks for sure.
Reply
Old Oct 18, 2007 | 06:56 AM
  #14  
recompile's Avatar
Thread Starter
Evolved Member
iTrader: (38)
 
Joined: Nov 2006
Posts: 1,745
Likes: 10
From: New Hampshire, USA
I fixed an upload bug that caused it to hang and not move past "Please wait..."

I will be working towards new features and bug fixes this weekend. There is currently a bug in which it will only take in the first 1024 lines of your log, so for people that have really long logs, it isn't working 100% right now.

Let me know if anyone has problems or feature requests.
Reply
Old Oct 18, 2007 | 06:44 PM
  #15  
galvitron's Avatar
Evolving Member
iTrader: (2)
 
Joined: Sep 2004
Posts: 287
Likes: 0
From: South Bay
Very cool idea!
Reply



All times are GMT -7. The time now is 08:32 PM.