Difference between revisions of "E-Ecology Documentation and Guidance"
From ecology
(→UvA-BiTS data) |
|||
| (31 intermediate revisions by the same user not shown) | |||
| Line 1: | Line 1: | ||
| − | The e-Ecology Virtual Laboratories represent a collaborative effort between the University of Amsterdam Institute for Biodiversity and Ecosystem Dynamics and | + | Last updated: February 2018, Stacy Shinneman |
| + | |||
| + | The e-Ecology Virtual Laboratories represent a collaborative effort between the University of Amsterdam Institute for Biodiversity and Ecosystem Dynamics and SURF Computing to manage bird tracking data and develop tools for data exploration, analysis and visualization. This wiki is designed to facilitate access to the data and tools within the Virtual Laboratories and to provide a forum for collaboration. | ||
| + | |||
| + | The e-Ecology database contains many different datasets, each of which is contained within its own schema. Prior to 2018, the e-Ecology database was also referred to as the FlySafe database. | ||
== UvA-BiTS Data == | == UvA-BiTS Data == | ||
| − | + | Bird data collected with the UvA-BiTS Bird Tracking System is managed within the gps schema of the e-Ecology database. | |
Note: We are continually working on improving UvA-BiTS services, including data processing and Virtual Lab functionality. In some cases, this has enabled us to extract more information from old GPS log files which is then incorporated into the database. These changes may result in slight differences when you reprocess historic data. | Note: We are continually working on improving UvA-BiTS services, including data processing and Virtual Lab functionality. In some cases, this has enabled us to extract more information from old GPS log files which is then incorporated into the database. These changes may result in slight differences when you reprocess historic data. | ||
| − | ::* [[ DB_Views_2015 | e-Ecology database for general use (views) ]] | + | ::* [[ DB_Views_2015 | e-Ecology UvA-BiTS database for general use (views) ]] |
| − | ::* [[ DB_Tables_2015 | e-Ecology tables behind the views (not accessible for normal use) ]] | + | ::* [[ DB_Tables_2015 | e-Ecology UvA-BiTS tables behind the views (not accessible for normal use) ]] |
| − | ::* [[ | + | ::* [[How to access the e-Ecology database]] |
| − | ::* [[ | + | ::* [[Reference systems for GPS coordinates and altitudes]] |
::* [[Useful Queries]] | ::* [[Useful Queries]] | ||
| − | |||
==UvA-BiTS Services== | ==UvA-BiTS Services== | ||
* Visualization Tools | * Visualization Tools | ||
| − | + | ||
| − | |||
| − | |||
| − | |||
:: [[KMZ Generator|UvA-BiTS KMZ Generator]]: <br /> | :: [[KMZ Generator|UvA-BiTS KMZ Generator]]: <br /> | ||
:::Produces kmz files of UvA-BiTS bird tracking data to be viewed in Google Earth. | :::Produces kmz files of UvA-BiTS bird tracking data to be viewed in Google Earth. | ||
| Line 27: | Line 27: | ||
:: [[Flight Generator]]: <br /> | :: [[Flight Generator]]: <br /> | ||
:::This tool produces GPX files from UvA-BiTS tracking data for dynamic [http://www.doarama.com Doarama] visualizations. | :::This tool produces GPX files from UvA-BiTS tracking data for dynamic [http://www.doarama.com Doarama] visualizations. | ||
| + | :: [[BirdView]]: <br /> | ||
| + | :::'''''This service is currently not available.''''' Access meterological and radar data and overlay with GPS bird tracking data. | ||
| + | :: [[BirdSim]]: <br/ > | ||
| + | :::'''''This service is currently not available.''''' More dynamic version of BirdView that allows the user to scroll through weather data in time and space. | ||
* [[Dashboard]]: These web pages allow UvA-BiTS users to get an overview of the raw data files of GPS bird tracking devices they have access to and to access the dashboard for administering projects. | * [[Dashboard]]: These web pages allow UvA-BiTS users to get an overview of the raw data files of GPS bird tracking devices they have access to and to access the dashboard for administering projects. | ||
| − | * [[ Annotation tables ]] for uploading GPS annotation data into your own schema. This service is currently not available. | + | * [[ Annotation tables ]] for uploading GPS annotation data into your own schema and sharing your tables with other users. '''''This service is currently not available.''''' |
* [[ SMS tables ]] for storage of SMS messages send by trackers. | * [[ SMS tables ]] for storage of SMS messages send by trackers. | ||
* [[ CartoDB ]] usage and limitation of CartoDB server | * [[ CartoDB ]] usage and limitation of CartoDB server | ||
| − | == Changes | + | == Changes to the UvA-BiTS data model in 2014 == |
'''Important''' | '''Important''' | ||
In the summer of 2014 we have '''re-arranged the administrative''' part of UvA-BiTS (and e-Ecology) in the database. End users may have to adapt their programs the following way: | In the summer of 2014 we have '''re-arranged the administrative''' part of UvA-BiTS (and e-Ecology) in the database. End users may have to adapt their programs the following way: | ||
| − | :* The '''uva_*_limited''' views that used to exist in the gps schema are gone. Most of them should have been replaced with an equivalent '''ee_*_limited counterpart'''. | + | :* The '''uva_*_limited''' views that used to exist in the gps schema are gone. Most of them should have been replaced with an equivalent '''ee_*_limited counterpart'''. |
:* The new ee_*_limited views show a superset of the same information as before, but enhanced with new project information. | :* The new ee_*_limited views show a superset of the same information as before, but enhanced with new project information. | ||
:* Some '''column names''' in the ee_*_limited views may differ from the previous views. | :* Some '''column names''' in the ee_*_limited views may differ from the previous views. | ||
| Line 45: | Line 49: | ||
:* Special attention: gps.uva_device_limited is now replaced by '''gps.ee_tracker_limited'''. For each tracker, you now see which project provides you access to that tracker. | :* Special attention: gps.uva_device_limited is now replaced by '''gps.ee_tracker_limited'''. For each tracker, you now see which project provides you access to that tracker. | ||
:* Also, '''gps.uva_tracking_limited''' is gone. Instead of that we have gps.ee_tracker_speed_limited, which adds speed columns to the original data. This amounts to a merger of gps.ee_tracking_limited, gps.ee_tracking_speed_3d_limited and gps.ee_tracking_speed_limited. | :* Also, '''gps.uva_tracking_limited''' is gone. Instead of that we have gps.ee_tracker_speed_limited, which adds speed columns to the original data. This amounts to a merger of gps.ee_tracking_limited, gps.ee_tracking_speed_3d_limited and gps.ee_tracking_speed_limited. | ||
| + | :* [[ UvAGPS|UvA-BiTS Data Model]] - OLD | ||
==Other e-Ecology Datasets== | ==Other e-Ecology Datasets== | ||
| Line 50: | Line 55: | ||
'''ENVIRONMENTAL DATA''' | '''ENVIRONMENTAL DATA''' | ||
| − | |||
::* [[ Elevation|Elevation Data ]] | ::* [[ Elevation|Elevation Data ]] | ||
| + | ::* [[ ECMWF|Weather Forecast Data (ECMWF)]] Restricted to FlySafe users. | ||
'''FLYSAFE''' | '''FLYSAFE''' | ||
| − | : | + | :Data related to European Space Agency FlySafe project. Financed by the Royal Netherlands Air Force. |
| − | ::* [[ | + | ::* [[Argos Data Model|Argos GPS Data Model]] |
| − | |||
::* [[ RADAR|Radar Data Model]] | ::* [[ RADAR|Radar Data Model]] | ||
::* [[ Wind profile|Wind Profile Data Model]] | ::* [[ Wind profile|Wind Profile Data Model]] | ||
| − | ::* [[ | + | ::* [[How to access the e-Ecology database]] |
==Other e-Ecology Services== | ==Other e-Ecology Services== | ||
| − | [[ | + | [[e-Ecology GPS Bird Track Generator]]: Produce kmz files of ARGOS/GPS bird tracking data from the FlySafe project to be viewed in Google Earth. |
[[ Administration]]: Information about user rights and data processing tasks. | [[ Administration]]: Information about user rights and data processing tasks. | ||
Latest revision as of 09:58, 22 January 2021
Last updated: February 2018, Stacy Shinneman
The e-Ecology Virtual Laboratories represent a collaborative effort between the University of Amsterdam Institute for Biodiversity and Ecosystem Dynamics and SURF Computing to manage bird tracking data and develop tools for data exploration, analysis and visualization. This wiki is designed to facilitate access to the data and tools within the Virtual Laboratories and to provide a forum for collaboration.
The e-Ecology database contains many different datasets, each of which is contained within its own schema. Prior to 2018, the e-Ecology database was also referred to as the FlySafe database.
Contents
UvA-BiTS Data
Bird data collected with the UvA-BiTS Bird Tracking System is managed within the gps schema of the e-Ecology database.
Note: We are continually working on improving UvA-BiTS services, including data processing and Virtual Lab functionality. In some cases, this has enabled us to extract more information from old GPS log files which is then incorporated into the database. These changes may result in slight differences when you reprocess historic data.
UvA-BiTS Services
- Visualization Tools
- UvA-BiTS KMZ Generator:
- Produces kmz files of UvA-BiTS bird tracking data to be viewed in Google Earth.
- Tracker Calendar:
- Calendar overview with daily statistics of GPS-tracker
- Flight Generator:
- This tool produces GPX files from UvA-BiTS tracking data for dynamic Doarama visualizations.
- BirdView:
- This service is currently not available. Access meterological and radar data and overlay with GPS bird tracking data.
- BirdSim:
- This service is currently not available. More dynamic version of BirdView that allows the user to scroll through weather data in time and space.
- UvA-BiTS KMZ Generator:
- Dashboard: These web pages allow UvA-BiTS users to get an overview of the raw data files of GPS bird tracking devices they have access to and to access the dashboard for administering projects.
- Annotation tables for uploading GPS annotation data into your own schema and sharing your tables with other users. This service is currently not available.
- SMS tables for storage of SMS messages send by trackers.
- CartoDB usage and limitation of CartoDB server
Changes to the UvA-BiTS data model in 2014
Important In the summer of 2014 we have re-arranged the administrative part of UvA-BiTS (and e-Ecology) in the database. End users may have to adapt their programs the following way:
- The uva_*_limited views that used to exist in the gps schema are gone. Most of them should have been replaced with an equivalent ee_*_limited counterpart.
- The new ee_*_limited views show a superset of the same information as before, but enhanced with new project information.
- Some column names in the ee_*_limited views may differ from the previous views.
- There are new limited views:
- gps.ee_project_limited: shows your projects' information
- gps.ee_shared_*_limited: set of data you are able to see related to trackers that a project is sharing with a project you belong to
- Special attention: gps.uva_device_limited is now replaced by gps.ee_tracker_limited. For each tracker, you now see which project provides you access to that tracker.
- Also, gps.uva_tracking_limited is gone. Instead of that we have gps.ee_tracker_speed_limited, which adds speed columns to the original data. This amounts to a merger of gps.ee_tracking_limited, gps.ee_tracking_speed_3d_limited and gps.ee_tracking_speed_limited.
- UvA-BiTS Data Model - OLD
Other e-Ecology Datasets
ENVIRONMENTAL DATA
- Elevation Data
- Weather Forecast Data (ECMWF) Restricted to FlySafe users.
FLYSAFE
- Data related to European Space Agency FlySafe project. Financed by the Royal Netherlands Air Force.
Other e-Ecology Services
e-Ecology GPS Bird Track Generator: Produce kmz files of ARGOS/GPS bird tracking data from the FlySafe project to be viewed in Google Earth.
Administration: Information about user rights and data processing tasks.
Bookkeeping: Description of tables related to e-Ecology data processing and archiving.
