Difference between revisions of "HOWTO Drifter Data Processing"

From Locl
Jump to navigationJump to search
(New page: <h1>Kirk's HOWTO on processing Drifter data</h1> <br> <h2>Follow these steps to process 'raw' drifter data from [http://www.pacificgyre.com pacificgyre] to final posting on our website:</h...)
 
Line 7: Line 7:
 
<li>Once proficient, it takes about 20 min to process a typical day's deployment.
 
<li>Once proficient, it takes about 20 min to process a typical day's deployment.
 
<li>Folders/files referenced here can be found on the ICESS network at /home/locl/users/kirk/ (hereafter referred to as '..../kirk/') in the <b>data</b> or <b>user</b> subfolders.
 
<li>Folders/files referenced here can be found on the ICESS network at /home/locl/users/kirk/ (hereafter referred to as '..../kirk/') in the <b>data</b> or <b>user</b> subfolders.
−
<li>You should copy the 'user' folder contents to your local computer and run the scripts there instead of on the server.
+
<li>You should copy the <i>kirk</i> folder contents to your local computer and run the scripts there instead of on the server.
 
</ul>
 
</ul>
 
<br>
 
<br>
Line 13: Line 13:
 
<h2>Folder:  .../kirk/user/0_Info</h2>
 
<h2>Folder:  .../kirk/user/0_Info</h2>
 
<li><b>On deployment day</b>: be sure to fill out .../kirk/user/0_Info/<b>drifter_hist.xls</b> (drifter history) with the
 
<li><b>On deployment day</b>: be sure to fill out .../kirk/user/0_Info/<b>drifter_hist.xls</b> (drifter history) with the
−
performance of the drifters to track if there are any consistent problems.<br>
+
performance of the drifters to track if there are any consistent problems (<i>Note that this file is now out of date</i>).<br>
 
<br>
 
<br>
 
<h2>Folder:  .../kirk/user/1_get_data_from_web</h2>
 
<h2>Folder:  .../kirk/user/1_get_data_from_web</h2>
Line 28: Line 28:
 
<li>Run <b>get_data.m</b> (be sure the <b>IRIDIUM</b> value in it is set correctly), data will be saved in '..../kirk/data/Drifter_Anal/2_data/<i>yyyymmdd</i>' folder as a <i>yyyymmdd_drifter_dat.log</i> file.<br>
 
<li>Run <b>get_data.m</b> (be sure the <b>IRIDIUM</b> value in it is set correctly), data will be saved in '..../kirk/data/Drifter_Anal/2_data/<i>yyyymmdd</i>' folder as a <i>yyyymmdd_drifter_dat.log</i> file.<br>
 
<ul>
 
<ul>
−
<li>Now, move that folder into a 'deployment type' folder (e.g. .../kirk/data/Drifter_Anal/2_data/<i>SBCLS</i>)<br>
+
<li>Now, move that folder into a 'deployment type' folder (e.g. .../kirk/data/Drifter_Anal/2_data/<b>SBCLS</b>)<br>
 
</ul>
 
</ul>
 
<br>
 
<br>
 
Notes:<br>
 
Notes:<br>
 
<ul>
 
<ul>
 +
<li>If IRIDIUM is set, you may want to check the settings of <b>REMOVE_GPS_01</b> and <b>CONVERT_GPS_2_TO_2</b> in the <b>convert_Iridium_reports_to_Microstar_format.m</b> file.
 
<li>Data format (column numbers):
 
<li>Data format (column numbers):
 
</ul>
 
</ul>
Line 52: Line 53:
 
     #15 in-water flag
 
     #15 in-water flag
 
</pre>
 
</pre>
 +
<h2>Folder:  .../kirk/user/2_clean_up</h2>
 +
<li>Edit <b>clean_up_drifter_data.m</b> with the correct <b>area</b> and <b>deploy_date</b> at the top.<br>
 +
 +
<br><br><br><br><br><br><br><br>

Revision as of 09:45, 20 June 2009

Kirk's HOWTO on processing Drifter data


Follow these steps to process 'raw' drifter data from pacificgyre to final posting on our website:


Notes:

  • Once proficient, it takes about 20 min to process a typical day's deployment.
  • Folders/files referenced here can be found on the ICESS network at /home/locl/users/kirk/ (hereafter referred to as '..../kirk/') in the data or user subfolders.
  • You should copy the kirk folder contents to your local computer and run the scripts there instead of on the server.


    Folder: .../kirk/user/0_Info

  1. On deployment day: be sure to fill out .../kirk/user/0_Info/drifter_hist.xls (drifter history) with the performance of the drifters to track if there are any consistent problems (Note that this file is now out of date).

    Folder: .../kirk/user/1_get_data_from_web

  2. Edit data_dates.m with the start/stop date/times to get.
    Notes:
    • Use the http://pacificgyre.com website (log: ohlmann, pass: drifterguy) if you need to get an estimation of when the drifters went in and came out of the water (look at in-water flag values), or go to http://www.icess.ucsb.edu/drifter/realtime/BETA.php and enter custom times.
    • Keep adding date/times to the bottom of this file (commented out), then copy your uncommented deployment times to the top of it to fetch the data.
    • You don't have to be exact on the times (cleanup happens in following steps), just be sure you have a time at least before or at start and a time after or at ending deployment.
  3. Run get_data.m (be sure the IRIDIUM value in it is set correctly), data will be saved in '..../kirk/data/Drifter_Anal/2_data/yyyymmdd' folder as a yyyymmdd_drifter_dat.log file.
    • Now, move that folder into a 'deployment type' folder (e.g. .../kirk/data/Drifter_Anal/2_data/SBCLS)


    Notes:

    • If IRIDIUM is set, you may want to check the settings of REMOVE_GPS_01 and CONVERT_GPS_2_TO_2 in the convert_Iridium_reports_to_Microstar_format.m file.
    • Data format (column numbers): 
          #1 drifter ID
      #2 year
      #3 month
      #4 day
      #5 hour
      #6 minute
      #7 second
      #8 lat
      #9 long
     #10 satelites availiable
     #11 satelites used
     #12 com flag
     #13 Secs to fix
     #14 Mobitex RSSI
     #15 in-water flag

    Folder: .../kirk/user/2_clean_up

  4. Edit clean_up_drifter_data.m with the correct area and deploy_date at the top.








Retrieved from "http://wiki-locl.eri.ucsb.edu/index.php?title=HOWTO_Drifter_Data_Processing&oldid=4"