Skip to content
/ awesome-datascience Public
forked from academic/awesome-datascience

📝 An awesome Data Science repository to learn and apply for real world problems.

License

MIT license
1 star 6k forks Branches Tags Activity
Star
Notifications You must be signed in to change notification settings

y6bt250/awesome-datascience

BranchesTags
 
 

Repository files navigation

Awesome Data Science Awesome Subscribe to new links

An open source Data Science repository to learn and apply towards solving real world problems.

Table of contents

Motivation

This part is for dummies who are new to Data Science

This is a shortcut path to start studying Data Science. Just follow the steps to answer the questions, "What is Data Science and what should I study to learn Data Science?"

First of all, Data Science is one of the hottest topics on the Computer and Internet farmland nowadays. People have gathered data from applications and systems until today and now is the time to analyze them. The next steps are producing suggestions from the data and creating predictions about the future. Here you can find the biggest question for Data Science and hundreds of answers from experts.

Secondly, Our favorite programming language is Python nowadays for #DataScience. Python's - Pandas library has full functionality for collecting and analyzing data. We use Anaconda to play with data and to create applications.

Infographic

Preview Description
A visual guide to Becoming a Data Scientist in 8 Steps by DataCamp (img)
Mindmap on required skills (img)
Swami Chandrasekaran made a Curriculum via Metro map.
by @kzawadz via twitter
By Data Science Central
From this article by Berkeley Science Review.
Data Science Wars: R vs Python
How to select statistical or machine learning techniques
Choosing the Right Estimator
The Data Science Industry: Who Does What
Data Science Venn Euler Diagram
Different Data Science Skills and Roles from this article by Springboard
Data Fallacies To Avoid A simple and friendly way of teaching your non-data scientist/non-statistician colleagues how to avoid mistakes with data. From Geckoboard's Data Literacy Lessons.

What is Data Science?

COLLEGES

MOOC's

Data Sets

Bloggers

Newsletters

  • AI Digest. A weekly newsletter to keep up to date with AI, machine learning, and data science. Archive.

Podcasts

Books

Facebook Accounts

Twitter Accounts

Youtube Videos & Channels

Telegram Channels

  • Open Data Science – First Telegram Data Science channel. Covering all technical and popular staff about anything related to Data Science: AI, Big Data, Machine Learning, Statistics, general Math and the applications of former.
  • Loss function porn — Beautiful posts on DS/ML theme with video or graphic vizualization.
  • Machinelearning – Daily ML news.

Toolboxes - Environment

  • Karate Club - An unsupervised machine learning extension library for NetworkX with a Scikit-Learn like API.
  • ML Workspace - All-in-one web-based IDE for machine learning and data science. The workspace is deployed as a Docker container and is preloaded with a variety of popular data science libraries (e.g., Tensorflow, PyTorch) and dev tools (e.g., Jupyter, VS Code).
  • neptune.ml -> Community-friendly platform supporting data scientists in creating and sharing machine learning models. Neptune facilitates teamwork, infrastructure management, models comparison and reproducibility.
  • steppy -> Lightweight, Python library for fast and reproducible machine learning experimentation. Introduces very simple interface that enables clean machine learning pipeline design.
  • steppy-toolkit -> Curated collection of the neural networks, transformers and models that make your machine learning work faster and more effective.
  • Datalab from Google easily explore, visualize, analyze, and transform data using familiar languages, such as Python and SQL, interactively.
  • Hortonworks Sandbox is a personal, portable Hadoop environment that comes with a dozen interactive Hadoop tutorials.
  • R is a free software environment for statistical computing and graphics.
  • RStudio IDE – powerful user interface for R. It’s free and open source, works onWindows, Mac, and Linux.
  • Python - Pandas - Anaconda Completely free enterprise-ready Python distribution for large-scale data processing, predictive analytics, and scientific computing
  • Scikit-Learn Machine Learning in Python
  • NumPy NumPy is fundamental for scientific computing with Python. It supports large, multi-dimensional arrays and matrices and includes an assortment of high-level mathematical functions to operate on these arrays.
  • SciPy SciPy works with NumPy arrays and provides efficient routines for numerical integration and optimization.
  • Data Science Toolbox - Coursera Course
  • Data Science Toolbox - Blog
  • Wolfram Data Science Platform Take numerical, textual, image, GIS or other data and give it the Wolfram treatment, carrying out a full spectrum of data science analysis and visualization and automatically generating rich interactive reports—all powered by the revolutionary knowledge-based Wolfram Language.
  • Sense Data Science Development Platform A New Cloud Platform for Data Science and Big Data Analytics Collaborate on, scale, and deploy data analysis and advanced analytics projects radically faster. Use the most powerful tools — R, Python, JavaScript, Redshift, Hive, Impala, Hadoop, and more — supercharged and integrated in the cloud.
  • Datadog Solutions, code, and devops for high-scale data science.
  • Variance Build powerful data visualizations for the web without writing JavaScript
  • Kite Development Kit The Kite Software Development Kit (Apache License, Version 2.0), or Kite for short, is a set of libraries, tools, examples, and documentation focused on making it easier to build systems on top of the Hadoop ecosystem.
  • Domino Data Labs Run, scale, share, and deploy your models — without any infrastructure or setup.
  • Apache Flink A platform for efficient, distributed, general-purpose data processing.
  • Apache Hama Apache Hama is an Apache Top-Level open source project, allowing you to do advanced analytics beyond MapReduce.
  • Weka Weka is a collection of machine learning algorithms for data mining tasks.
  • Octave GNU Octave is a high-level interpreted language, primarily intended for numerical computations.(Free Matlab)
  • Apache Spark Lightning-fast cluster computing
  • Hydrosphere Mist - a service for exposing Apache Spark analytics jobs and machine learning models as realtime, batch or reactive web services.
  • Caffe Deep Learning Framework
  • Torch A SCIENTIFIC COMPUTING FRAMEWORK FOR LUAJIT
  • Nervana's python based Deep Learning Framework
  • Skale - High performance distributed data processing in NodeJS
  • Aerosolve - A machine learning package built for humans.
  • Intel framework - Intel® Deep Learning Framework
  • Datawrapper – An open source data visualization platform helping everyone to create simple, correct and embeddable charts. Also at github.com
  • Tensor Flow - TensorFlow is an Open Source Software Library for Machine Intelligence
  • Natural Language Toolkit
  • nlp-toolkit for node.js
  • Julia – high-level, high-performance dynamic programming language for technical computing
  • IJulia – a Julia-language backend combined with the Jupyter interactive environment
  • Apache Zeppelin - Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more
  • Featuretools - An open source framework for automated feature engineering written in python
  • Optimus - Cleansing, pre-processing, feature engineering, exploratory data analysis and easy ML with PySpark backend.
  • Albumentations - А fast and framework agnostic image augmentation library that implements a diverse set of augmentation techniques. Supports classification, segmentation, detection out of the box. Was used to win a number of Deep Learning competitions at Kaggle, Topcoder and those that were a part of the CVPR workshops.
  • DVC - An open-source data science version control system. It helps track, organize and make data science projects reproducible. In its very basic scenario it helps version control and share large data and model files.
  • Lambdo is a workflow engine which significantly simplifies data analysis by combining in one analysis pipeline (i) feature engineering and machine learning (ii) model training and prediction (iii) table population and column evaluation.
  • Feast - A feature store for the management, discovery, and access of machine learning features. Feast provides a consistent view of feature data for both model training and model serving.
  • Polyaxon - A platform for reproducible and scalable machine learning and deep learning.
  • LightTag - Text Annotation Tool for teams
  • Trains - Auto-Magical Experiment Manager, Version Control & DevOps for AI
  • Hopsworks - Open-source data-intensive machine learning platform with a feature store. Ingest and manage features for both online (MySQL Cluster) and offline (Apache Hive) access, train and serve models at scale.
  • MindsDB - MindsDB is an Explainable AutoML framework for developers. With MindsDB you can build, train and use state of the art ML models in as simple as one line of code.
  • Lightwood - A Pytorch based framework that breaks down machine learning problems into smaller blocks that can be glued together seamlessly with an objective to build predictive models with one line of code.
  • AWS Data Wrangler - An open-source Python package that extends the power of Pandas library to AWS connecting DataFrames and AWS data related services (Amazon Redshift, AWS Glue, Amazon Athena, Amazon EMR, etc).

Visualization Tools - Environments

Journals, Publications and Magazines

Presentations

Competitions

Some data mining competition platforms

Comics

Digital Data

Tutorials

Free Courses

Other Awesome Lists

About

📝 An awesome Data Science repository to learn and apply for real world problems.

Resources

Readme

License

MIT license
Activity

Stars

1 star

Watchers

1 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

No packages published