Sources and Resources (SandR)

Computer Vision and Machine learning in one place.

Interactive computing in notbooks and documentation utils👩🏻‍💻:

• Binder Running Notbooks from Repositories

• RISE Interactive Presentations with runnable code

• Colab GPU/TPU access

• Sphinx𓂀 Python Documentation generator

• MyST-nb Notebooks to markdown with extended css

• JupyterLab Next-generation interface for Project Jupyter

• Jupyter Book Build publication-quality books and docs from notebooks and Markdown

• Quarto Scientific and technical publishing with notebooks and Markdown

Model Tuning:

• optuna

• ray

GIS/Satelite 🛰:

• OS UK Vector maps etc

• ONS Goeportal UK Local Authority Boundary Data as .shp files.

• Copernicus Browser Browse Sentinel satellite data online

• Copernicus Data Space Ecosystem EU satellite data available through OData API

Political/Conflict:

• Stockholm International Peace Research Institute SPIRI Databases
• The Peace Research Institute Oslo (PRIO) datasets
• Journal of Peace Research (JPR) datasets
• The Armed Conflict Location & Event Data Project DATA EXPORT TOOL
• Global Terrorism Database database
• University of Central Florida

Demographics/Migration/People/Gender/Equalities:

• Women Stats Project dataset
• UK Home Office Migration Statistics dataset
• Organization for Economic Coeperation and Development International Migration
• Migration Data Portal collated by International Organization for Migration (IOM) datasets

Computer Vision (Wider Domains)👀:

• PyTorch - CV Datasets

• Tensorflow - CV Datasets

• CVonline: Image Databases

• Yet Another Computer Vision Index To Datasets (YACVID)

• PapersWithCode

• RoboFlow

• VisualData

• CUHK Computer Vision

• ImageNet

• Oxford Visual Geometry Group (VGG)

• FiftyOne Visual dataset exploration and model evaluation

• Albumentations Fast image augmentations library

Computer Vision (Medical Imaging):

• Brain Imagery
• Chest X-ray
• Stanford Medical
• Grand Challenges

Computer Vision Image Classification:

• Oxford Flower Dataset

Aesthetics and Image Quality Assesmet:

• Victoria and Albert Musium API

3d Imaging:

• Shape Net
• Pytorch 3d

NLP ✒️:

• Indiana Institute of Techonolgy Corpora
• Stanford NLP home> Corpus > Stanford NLP resources > code >
• Stanford NLP home >
• Stanford Sentiment Analisis dataset
• Stanford Amazone Reviews dataset
• Conrnell Movie Dialoge Corpus dataset
• Project Gutenberg Corpus python library
• Twitter/X api

Transport:

• Open Flights data (GitHub)
• Airline Time Performance dataset
• Transport for London (TfL) Bike Point api

Audio

RAVE -- publication

Misc ML (ALL of Above):

• German Research Centre for Artificial Intelligence

First Pricipals (maths, algorythms etc)

• Book maths of machine leanring , associated ropository
• Book Introduction to Linear Algebra
• Course site explaining cnns for vision

Worked Examples

Type	Notebook
Evaluation Metrics
Image Restoration (ViT)
Visualizing ViTs

Python

• Low Level .jpg in python

Vector Stores

• Chroma DB Vector database for embeddings with a simple Python API. Docs
• Qdrant Open-source vector database focused on performance and recall. Docs
• Milvus Open-source, highly scalable vector database. Docs
• Weaviate Open-source vector database with hybrid search and modules. Docs
• pgvector PostgreSQL extension for vector similarity search. Docs
• OpenSearch k-NN Open-source search with vector k-NN. Docs
• Vespa Open-source engine for vector, text, and recommendation search. Docs

Cloud Infra (GCP, AWS, Azure for AI/ML)

• Vertex AI
• BigQuery ML
• Cloud Storage
• Google Kubernetes Engine (GKE)
• Dataflow

LLM Tooling

• Ollama Run and manage LLMs locally
• Hugging Face Models, datasets, and libraries like Transformers

Agent Frameworks

• PydanticAI Build typed, reliable LLM agents using Pydantic. GitHub
• LangChain Framework for LLM apps and agents. GitHub
• CrewAI Multi-agent framework for collaborative AI agents. GitHub

LLM Overview

• Low-code
  • Flowise: Drag & drop UI to build LangChain flows. GitHub Repo stars — https://github.com/FlowiseAI/Flowise
  • Langflow: Visual builder for LangChain apps. GitHub Repo stars — https://github.com/langflow-ai/langflow
• Services / Tools
  • Dify: One interface for prompt engineering, datasets, and plugins for AI apps. GitHub Repo stars — https://github.com/langgenius/dify
  • Chainlit: Build Python UIs to debug and share LLM apps. GitHub Repo stars — https://github.com/Chainlit/chainlit
  • GPTCache: Semantic cache for LLM queries. GitHub Repo stars — https://github.com/zilliztech/GPTCache
  • LlamaHub: Community loaders for LLMs (documents, connectors). GitHub Repo stars — https://github.com/run-llama/llama-hub
• Agents
  • AutoGen: Multi-agent framework for LLM applications. GitHub Repo stars — https://github.com/microsoft/autogen
  • LangGraph: Directed graph framework for building stateful agents on LangChain. GitHub Repo stars — https://github.com/langchain-ai/langgraph
  • CrewAI: Orchestrate role-playing autonomous AI agents. GitHub Repo stars — https://github.com/crewai/crewai

Fast Deployment

• Vercel Frontend and edge deployment platform
• Netlify Web apps and serverless functions hosting