Distributed Computing

Curated Resources (32)

Tools (4)

• Kubernetes kubernetes.iofree

  An open-source container orchestration engine for automating deployment, scaling, and management of distributed applications.

• Apache Spark spark.apache.orgfree

  An open-source unified analytics engine for large-scale distributed data processing and parallel computation.

• Apache Kafka kafka.apache.orgfree

  A distributed event streaming platform used for building high-throughput, fault-tolerant distributed data pipelines.

• Ray ray.iofree

  An open-source unified framework for scaling artificial intelligence, machine learning, and Python workloads across distributed clusters.

Databases (4)

• Common Crawl commoncrawl.orgfree

  Open repository of web crawl data petabytes in size, widely used for distributed processing benchmarks and training web-scale models.

• Registry of Open Data on AWS registry.opendata.awsfree

  Repository of large-scale open datasets hosted for distributed analytics, high-performance computing, and machine learning.

• Data.gov data.govfree

  The United States government open data repository, offering hundreds of thousands of datasets across scientific, social, and economic domains.

• Kaggle Datasets kaggle.comfree

  Public community platform hosting thousands of diverse datasets for distributed analysis and predictive modeling.

Learn (11)

• Designing Data-Intensive Applications dataintensive.netpaid

  Comprehensive book by Martin Kleppmann exploring principles, architectures, and trade-offs of distributed data systems.

• Distributed Systems (van Steen and Tanenbaum) distributed-systems.netfree

  Foundational computer science textbook covering architectures, processes, communication, coordination, and fault tolerance in distributed systems.

• Kubernetes Documentation kubernetes.iofree

  Official guide and reference documentation for container orchestration, cluster architecture, and distributed service management.

• Apache Spark Documentation spark.apache.orgfree

  Official reference and programming guides for scalable cluster computing and distributed data processing with Apache Spark.

• Cloud Run Documentation docs.cloud.google.comfree

  Google Cloud documentation for Cloud Run, a managed platform for running containers, covering deployment from source, the container contract and configuration.

• Cloud Architecture Center docs.cloud.google.comfree

  Google Cloud collection of reference architectures, design guides and best practices for building reliable, secure and scalable systems in the cloud.

• A Gentle Introduction to Blockchain Technology bitsonblocks.netfree

  Plain-language explainer of how blockchains, distributed ledgers and consensus work, aimed at business readers and students without a technical background.

• Minimum Viable Block Chain igvita.comfree

  Step-by-step essay that builds up the design of a blockchain from first principles, explaining signatures, proof of work and double-spend protection for engineers.

• AWS Roadmap (roadmap.sh) roadmap.shfree

  Interactive roadmap on Amazon Web Services: topics laid out in a suggested study order, each linking to further reading.

• Cloudflare Roadmap (roadmap.sh) roadmap.shfree

  Interactive roadmap on building on the Cloudflare platform: topics laid out in a suggested study order, each linking to further reading.

• Kubernetes Roadmap (roadmap.sh) roadmap.shfree

  Interactive roadmap on container orchestration with Kubernetes: topics laid out in a suggested study order, each linking to further reading.

Publications (4)

• ACM Transactions on Storage dl.acm.orgfree

  Peer-reviewed ACM journal publishing research on storage systems, distributed file systems, and reliable data storage architectures.

• IEEE Transactions on Parallel and Distributed Systems ieeexplore.ieee.orgpaid

  Premier academic journal publishing research on parallel architectures, distributed algorithms, fault tolerance, and cloud computing.

• Communications of the ACM cacm.acm.orgfree

  Flagship monthly print and online publication of the ACM covering critical computing breakthroughs, distributed architectures, and software systems.

• arXiv Distributed, Parallel, and Cluster Computing (cs.DC) arxiv.orgfree

  Open-access archive for recent research preprints covering distributed systems, parallel computing, and cluster architectures.

Blogs and sites (5)

• The Morning Paper blog.acolyer.orgfree

  Influential archive curated by Adrian Colyer offering accessible summaries of milestone computer science and distributed systems research papers.

• Martin Kleppmann's Blog martin.kleppmann.comfree

  Technical blog covering distributed systems, local-first software, CRDTs, and database replication.

• Kubernetes Blog kubernetes.iofree

  Official blog highlighting architectural patterns, release features, and technical updates from the Kubernetes distributed computing ecosystem.

• AWS Architecture Blog aws.amazon.comfree

  Technical articles, best practices, and patterns for building scalable, resilient distributed applications on cloud infrastructure.

• IPFS Forum discuss.ipfs.techfree

  Discussion forum for the InterPlanetary File System community, where users and developers ask questions and share projects about decentralized storage.

Events and conferences (4)

• USENIX Symposium on Operating Systems Design and Implementation (OSDI) usenix.orgfree

  Premier academic conference bringing together researchers and system builders to present innovative research on distributed and operating systems.

• ACM Symposium on Operating Systems Principles (SOSP) sosp.orgfree

  Flagship bi-annual conference presenting foundational and state-of-the-art research on operating and distributed computing systems.

• ACM Symposium on Principles of Distributed Computing (PODC) podc.orgfree

  Premier annual international forum for foundational research on the theory, design, and analysis of distributed systems.

• IEEE International Conference on Distributed Computing Systems (ICDCS) computer.orgpaid

  Annual academic conference focusing on advancements in distributed algorithms, cloud computing, and distributed storage systems.

Other subcategories

Artificial Intelligence · Machine Learning · Big Data · Computer Information Systems · Computer Science · Computer Vision · Cyber Security · Data Science · Databases · Hardware · Human-Computer Interaction · IT Certification · Natural Language Processing · Networking · Operating Systems · Robotics · Software Engineering

Part of Computing