Data Aggregator

Data Aggregator is an open-source tool designed to integrate biodiversity data into a Darwin Core compatible format. It provides a robust framework for scientists, researchers, and biodiversity data managers to standardize and consolidate various data sources.

Features

• Manage your GrSciColl collection data in a web interface
• Upload your biodiversity data in CSV format
• Map your data to the darwin core format
• Upload your images and map them to your data
• Encode the data to have enriched information for taxonomy, geolocation (forward and reverse), swiss species registry and iucn redlists
• Export data to CSV for further processing on your end
• Retrieve your data trought the REST API
• Submit data for validation to infospecies centers
• Publish your collection data to gbif

Project

• Report a bug or request a feature by creating an issue
• Contribute by submitting a pull request
• Explore the current data model
• View our development notes on Miro

Quick Setup

Prerequisites

• Elixir (see .tool-versions for the recommended version)
• Erlang (see .tool-versions for the recommended version)
• PostgreSQL
• Node.js and npm

Installation

1. Clone the repository

   git clone https://github.com/yourusername/data_aggregator.git
   cd data_aggregator

2. Install dependencies

   mix deps.get

3. Configure the database (copy config/dev.exs.example to config/dev.exs if available and update settings)

4. Create and migrate your database and build assets

   mix setup

5. Start the Phoenix server

   mix phx.server

Now you can visit localhost:4000 from your browser.

Documentation

Project Documentation

• Overview
• Development
• Deployment
• API
• Security
• License
• Code Of Conduct
• Contribution

API Documentation

When running the application, you can access:

• Swagger UI (local development)
• ReDoc (local development)
• HexDocs (local development)

For production instances, replace the localhost URL with your deployment URL.

Development Tools Resources

• Styleguide
• Dashboard
• Oban Job Queue

Contributing

We welcome contributions! Please see our Contributing Guide for details on how to get started.

Please note that this project adheres to a Code of Conduct. By participating in this project, you agree to abide by its terms.

By contributing to this project, you agree that your contributions will be licensed under the GNU AGPLv3 license.

Security

For information about our security policy and how to report security vulnerabilities, please see our Security Policy.

License

This project is licensed under the GNU Affero General Public License v3.0 - see the LICENSE file for details.

We provide additional documentation to help you understand and comply with the AGPLv3:

• License Implications - Understanding what AGPLv3 means for your use case
• AGPLv3 Compliance Guide - Practical guide to compliance

Acknowledgements

• Thanks to all our contributors
• Built with Phoenix, Ash Framework, and Tailwind CSS
• Darwin Core standards by TDWG