1. Forum
  3. Development
  5. Development
  7. Datalogger

Datalogger

  • rbe2012
  • rbe2012's Avatar
  • Offline
  • So much to do, so little time...
More
01 Jul 2013 08:38 #11669 by rbe2012
Replied by rbe2012 on topic Datalogger
Data logging starts if a valid switch for enabling is selected (also when scrolling to the wanted position.
I would prefer the logging to be disabled as long as configuration is not finished.

Please Log in or Create an account to join the conversation.

  • rbe2012
  • rbe2012's Avatar
  • Offline
  • So much to do, so little time...
More
01 Jul 2013 08:44 - 01 Jul 2013 08:50 #11670 by rbe2012
Replied by rbe2012 on topic Datalogger
I get no valid results when logging. These are the observations I have made so far:

- Sometimes "empty" lines (with invalid values, esp. timers=0) appear without changing any inputs
- often the converting to CSV stops with a message like "Cannot handle API version 0xe7" (with various versions 0x2b, 0xb8, 0x71...)
- often I have only a few or even one line in the csv output (can be an impact of the previous)
- I have chosen (with others) the rtclock, but it only appeared in the header line when I choose "All" (also no data from the clock logged).

EDIT: Forgot to tell that I use emu_devo12-v3.0.0-9caabf.
Last edit: 01 Jul 2013 08:50 by rbe2012.

Please Log in or Create an account to join the conversation.

More
01 Jul 2013 13:33 #11671 by PhracturedBlue
Replied by PhracturedBlue on topic Datalogger
rbe, I think all your problems are because I had altered the way gps was displayed and didn't update the converter accordingly. Those should be fixed. If not, send me your datalog.bin

I'm not quite sure what you mean by datalogging begins before you are finished. You cannot setup the switches while the datalogger is running. There is the potential (say when moving from None to 'THR' to capture some spurious events. That is what the reset button is for :)
I could add a 'Save' / 'Cancel' button and cache all changes. I didn't think it was worthwhile, but it isn't too difficult.

Please Log in or Create an account to join the conversation.

  • rbe2012
  • rbe2012's Avatar
  • Offline
  • So much to do, so little time...
More
01 Jul 2013 16:06 #11676 by rbe2012
Replied by rbe2012 on topic Datalogger
I will test again later.

Logging while changing: I have seen the free bytes going down when I move through the switches - some of them were active (like one of GEAR0/1). Because the output was not what I expected I can not say if something useful was logged at this time or not.
To clarify: I spoke about changing the enable-switch, not the data sources.

Please Log in or Create an account to join the conversation.

More
01 Jul 2013 17:46 #11678 by PhracturedBlue
Replied by PhracturedBlue on topic Datalogger
I will make it so that the 1st capture occurs at current time + <x> each time the enable is changed. That gives you time to set it to a useful value. I think X of around 3 to 5 seconds is probably reasonable.

Please Log in or Create an account to join the conversation.

  • rbe2012
  • rbe2012's Avatar
  • Offline
  • So much to do, so little time...
More
01 Jul 2013 18:41 - 01 Jul 2013 18:42 #11679 by rbe2012
Replied by rbe2012 on topic Datalogger
With version emu_devo12-v3.0.0-5eecb1 I still get
$ ../utils/datalog2csv.py -a --bin filesystem/devo8/datalog.bin --out=test.csv
Cannot handle API version 0x02

File Attachment:

File Name: datalog.bin.zip
File Size:0 KB


I tried to log Timer1, Ch3, Ch6, THR, GEAR0, GEAR1 and RTC Time
Attachments:
Last edit: 01 Jul 2013 18:42 by rbe2012. Reason: zipped datalog.bin

Please Log in or Create an account to join the conversation.

  • rbe2012
  • rbe2012's Avatar
  • Offline
  • So much to do, so little time...
More
01 Jul 2013 18:51 #11680 by rbe2012
Replied by rbe2012 on topic Datalogger
Logged everything for about 15s in 1s interval. Result:
-/c/Workspace/PhracturedBlue/- src
$ ../utils/datalog2csv.py -a --bin filesystem/devo8/datalog.bin --out=test.csv

-/c/Workspace/PhracturedBlue/- src
$ cat test.csv
Timer1,Timer2,Timer3,Timer4,Volt1,Volt2,Volt3,Temp1,Temp2,Temp3,Temp4,RPM1,RPM2,AIL,ELE,THR,RUD,AUX2,AUX3,AUX4,AUX5,AUX6,AUX7,RUD_DR0,RUD_DR1,RUD_DR2,ELE_DR0,ELE_DR1,ELE_DR2,AIL_DR0,AIL_DR1,AIL_DR2,GEAR0,GEAR1,MIX0,MIX1,MIX2,FMODE0,FMODE1,FMODE2,HOLD0,HOLD1,TRAIN0,TRAIN1,Channel1,Channel2,Channel3,Channel4,Channel5,Channel6,Channel7,Channel8,Channel9,Channel10,Channel11,Channel12,Virt1,Virt2,Virt3,Virt4,Virt5,Virt6,Virt7,Virt8,Virt9,Virt10,PPM1,PPM2,PPM3,PPM4,PPM5,PPM6,PPM7,PPM8,Latitude,,Longitude,Altitude,Velocity,GPSTime,Clock
0,0,0,0,0,0,0,0,0,156,0,0,0,100,156,156,100,156,156,100,156,156,156,100,100,156,156,100,156,156,100,156,100,156,0,0,156,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,2364145664,739559249,16712402,658688,0

-/c/Workspace/PhracturedBlue/- src
$ cat test.csv | awk '{ line++; n=split($0,X,","); printf "Line %d: %s items\n", line, n;}'
Line 1: 81 items
Line 2: 80 items
Where has the RTC gone?

Am I doing something completely wrong? I am in doubt of myself actually...

Please Log in or Create an account to join the conversation.

More
01 Jul 2013 19:56 #11684 by PhracturedBlue
Replied by PhracturedBlue on topic Datalogger
you did everything right. Still some bugs in the script it seems.

Please Log in or Create an account to join the conversation.

  • rbe2012
  • rbe2012's Avatar
  • Offline
  • So much to do, so little time...
More
01 Jul 2013 21:09 #11690 by rbe2012
Replied by rbe2012 on topic Datalogger
I have tested it shortly on my Devo12 and everything looks fine as far as I have seen. Some jumps in the data, but a correct datalog.bin and enough data inside:
Timer1,THR,GEAR0,GEAR1,Channel3,Channel6,GPSTime
0,54,156,100,156,24,47343745
0,32,156,100,156,19,47343746
0,32,156,100,156,19,47343747
0,32,156,100,156,19,47343748
0,32,156,100,156,19,47343749
0,32,156,100,156,19,47343750
0,32,156,100,156,19,47343751
0,157,156,100,156,250,47343752
0,216,156,100,156,5,47343753
0,98,156,100,90,32,47343754
1,191,156,100,90,0,47343755
2,21,156,100,90,17,47343756
3,215,156,100,90,5,47343757
4,204,156,100,90,3,47343758
5,156,156,100,90,249,47343759
6,87,156,100,90,30,47343760
7,191,156,100,90,0,47343761
13,100,156,100,90,33,47343769
14,156,156,100,90,250,47343770
15,159,156,100,90,250,47343771
12,1,128,0,0,3,576
Timer1,THR,GEAR0,GEAR1,Channel3,Channel6,GPSTime
17,156,100,156,156,250,47343779
12,1,128,0,0,3,576
Timer1,THR,GEAR0,GEAR1,Channel3,Channel6,GPSTime
19,64,100,156,66,25,47343785
19,231,100,156,37,8,47343786
20,157,100,156,156,250,47343787
20,157,100,156,156,250,47343788
20,157,100,156,156,250,47343789
20,157,100,156,156,250,47343790
20,157,100,156,156,250,47343791
0,0,0,0,0,0,0
Strange: jump in timer1 (17-12-19, 5 lines with 20; could be hanging while USB active...no, no more lines after a few minutes), values of 100/156 for GEAR0/1 (expected -100/+100 - ah: 156=256-100!! - unusual output...)

Please Log in or Create an account to join the conversation.

More
01 Jul 2013 21:36 #11691 by PhracturedBlue
Replied by PhracturedBlue on topic Datalogger
It looks like the last sample when the enable changes is bad, otherwise the data looks ok. As you noted, bytes values are currently unsigned and should be signed. I'll need to work on each of the others to show the data properly

Please Log in or Create an account to join the conversation.

More
02 Jul 2013 05:16 #11710 by PhracturedBlue
Replied by PhracturedBlue on topic Datalogger
I've updated the csv script to properly display values for all data types (I hope). The jumps in your data are i think caused by an off-by-one error in my code. I think I've fixed that too.
Let me know if you see more issues.

Please Log in or Create an account to join the conversation.

  • rbe2012
  • rbe2012's Avatar
  • Offline
  • So much to do, so little time...
More
02 Jul 2013 05:26 #11713 by rbe2012
Replied by rbe2012 on topic Datalogger
I tested with the datalog.bin from yesterday. I still get an error and the last line seems to be wrong, but the rest makes sense and looks much better:
-/x/Transfer/privat/Workspace/PhractuedBlue/deviation/- src
$ hg summary
parent: 1797:e5d75984334d tip
 Off by one error
branch: default
commit: 1 unknown (clean)
update: (current)

-/x/Transfer/privat/Workspace/PhractuedBlue/deviation/- src
$ ../utils/datalog2csv.py -a --bin filesystem/devo8/datalog.bin --out=log
Cannot handle API version 0x02

-/x/Transfer/privat/Workspace/PhractuedBlue/deviation/- src
$ cat log
Timer1,THR,GEAR0,GEAR1,Channel3,Channel6,Clock
00:00,-100,-100,100,-101,0,08:33:43 2013-12-30
00:00,-100,-100,100,-101,0,08:33:44 2013-12-30
00:00,-100,-100,100,-101,0,08:33:45 2013-12-30
00:00,-100,-100,100,-101,0,08:33:46 2013-12-30
00:00,-100,-100,100,-101,0,08:33:47 2013-12-30
00:00,-100,-100,100,-101,0,08:33:48 2013-12-30
00:00,-100,-100,100,-101,0,08:33:49 2013-12-30
00:00,-100,-100,100,-101,0,08:33:50 2013-12-30
00:00,-100,-100,100,-101,0,08:33:51 2013-12-30
00:00,-100,-100,100,-101,0,08:33:52 2013-12-30
00:00,-100,-100,100,-101,0,08:33:53 2013-12-30
00:00,-100,-100,100,-101,0,08:33:54 2013-12-30
00:00,-100,-100,100,-101,0,08:33:55 2013-12-30
00:00,-100,-100,100,-101,0,08:33:56 2013-12-30
00:00,-100,-100,100,-101,0,08:33:57 2013-12-30
00:00,-100,-100,100,-101,0,08:33:58 2013-12-30
00:00,-100,-100,100,-101,0,08:33:59 2013-12-30
00:00,20,-100,100,18,0,08:34:00 2013-12-30
00:00,20,-100,100,18,0,08:34:01 2013-12-30
00:00,20,-100,100,18,0,08:34:02 2013-12-30
00:00,20,-100,100,18,0,08:34:03 2013-12-30
00:00,20,-100,100,18,0,08:34:04 2013-12-30
00:00,20,-100,100,18,0,08:34:05 2013-12-30
00:00,20,-100,100,18,0,08:34:06 2013-12-30
00:00,20,-100,100,18,0,08:34:07 2013-12-30
00:00,20,-100,100,18,0,08:34:08 2013-12-30
00:00,20,-100,100,18,0,08:34:09 2013-12-30
00:00,20,-100,100,18,0,08:34:10 2013-12-30
00:00,20,-100,100,18,0,08:34:11 2013-12-30
00:00,20,-100,100,18,0,08:34:12 2013-12-30
00:00,20,-100,100,18,0,08:34:13 2013-12-30
00:00,20,-100,100,18,0,08:34:14 2013-12-30
00:00,20,-100,100,18,0,08:34:15 2013-12-30
00:00,20,-100,100,18,0,08:34:16 2013-12-30
00:00,20,-100,100,18,0,08:34:17 2013-12-30
00:00,20,-100,100,18,0,21:24:29 2123-12-40207

I will make some more realistic tests...

Please Log in or Create an account to join the conversation.

More
02 Jul 2013 05:34 #11714 by PhracturedBlue
Replied by PhracturedBlue on topic Datalogger
yes your datalog from yesterday is corrupt. that is disturbing, and I haven't made any changes that are likely to affect that so the bug is likely still there to be teased out. I haven't been able to replicate it on the simulator so far.

Please Log in or Create an account to join the conversation.

More
22 Jul 2013 15:49 #12431 by Hexperience
Replied by Hexperience on topic Datalogger
I don't know how I missed all this...

PB, you are the best.... :)

Can't wait to get my RPM sensors and test this out... CHEERS!!!!!!
There are 10 types of people in this world. Those that understand binary and those that don't.

Please Log in or Create an account to join the conversation.

More
23 Jul 2013 18:02 - 23 Jul 2013 18:03 #12454 by Hexperience
Replied by Hexperience on topic Datalogger
Devo12 crash. I'm pretty sure the datalog file filled up and now I can't get into the devo12. When I turn it on I only get the usb screen and windows tells me to format it... :(

Of course I have backups of everything, but this wouldn't be good at the field... ;)


AHHH crud... added a couple of models since my backup...

Anyway to get into the devo when it's in this state?
There are 10 types of people in this world. Those that understand binary and those that don't.
Last edit: 23 Jul 2013 18:03 by Hexperience.

Please Log in or Create an account to join the conversation.

More
17 Aug 2013 06:27 #13013 by Kdean
Replied by Kdean on topic Datalogger
Hey pb, how is this project coming along?

Please Log in or Create an account to join the conversation.

More
17 Feb 2014 14:22 #20447 by mazi
Replied by mazi on topic Datalogger
Where can I find any tool to convert logged data? Manual says look in download section, but I can't find anyfing like this there.

Please Log in or Create an account to join the conversation.

More
17 Feb 2014 14:31 #20450 by PhracturedBlue
Replied by PhracturedBlue on topic Datalogger
I should probably add it huh.

The code is here:
bitbucket.org/PhracturedBlue/deviation/r...utils/datalog2csv.py

You need python installed to use it.

Please Log in or Create an account to join the conversation.

More
17 Feb 2014 19:27 #20465 by Hexperience
Replied by Hexperience on topic Datalogger
Has there been anyone working on an overall PC app?

It could include;
-usb flasher
-datalog display
-model editor/backup/organizer
-icon creator
-emu (select-able tx model)
-template organizer/creator for screens

I wish I had the skills to do such a thing.
There are 10 types of people in this world. Those that understand binary and those that don't.

Please Log in or Create an account to join the conversation.

More
18 Feb 2014 00:38 #20485 by PhracturedBlue
Replied by PhracturedBlue on topic Datalogger
The Java App I started was supposed to make it easy to install firmware (especially on the dveo7e/12 were multiple steps are needed). I just got side-tracked with other activities and haven't gotten back to it.

Please Log in or Create an account to join the conversation.

  1. Forum
  3. Development
  5. Development
  7. Datalogger
Time to create page: 0.099 seconds
Powered by Kunena Forum
Re-enable mobile display