jamesm.blog
  • Search
  • Tags
  • AI
  • Blockchain
  • Data Eng
  • Data Science
  • DevOps
  • General
  • Music
  • Personal Dev
  • Retro
  • Space
Home

DevOps

DevOps resources, tools, best practices, courses, and documentation for cloud infrastructure, CI/CD, containerization, and operational excellence.

AWS S3 Files - Bridging File Systems and Object Storage

Amazon Web Services recently introduced AWS S3 Files, a service that addresses a persistent challenge in cloud computing - how to give file-based applications direct access to object storage without duplicating data or building custom connectors. The Problem S3 Files Solves Traditionally, applications designed around file systems faced a difficult choice when working with Amazon S3: Use object APIs - Build custom integration code and refactor applications Duplicate data - Copy data between S3 and separate file systems, creating sync challenges and increased costs Accept performance trade-offs - Work with slower, network-dependent access patterns S3 Files eliminates these constraints by providing a native file system interface directly over S3 data. ...

April 9, 2026 · 4 min · James M

DevOps in the Age of AI Agents

For years, DevOps has been about breaking down silos and automating the software delivery lifecycle. We moved from manual deployments to Jenkins scripts, then to YAML-defined pipelines, and eventually to Infrastructure as Code (IaC). But in 2026, the bottleneck is no longer the speed of the pipeline - it’s the speed of human decision-making within that pipeline. We are entering the era of Agentic DevOps. From Automation to Autonomy Traditional DevOps automation follows a strict “if this, then that” logic. AI-driven DevOps uses reasoning models to handle the “I’m not sure, let me figure it out” scenarios that typically stall a release. ...

April 5, 2026 · 3 min · James M

Mac Homebrew packages

Essential bat - Cat alternative with syntax highlighting and Git integration fzf - Fuzzy finder for CLI (command history, file search, etc.) glow - Markdown reader in the terminal htop - Interactive process monitor with colors and mouse support jq - JSON query and manipulation tool (sed for JSON) pyenv - Python version manager python - Python (3.11+) ripgrep (rg) - Fast, recursive grep alternative terraform - Infrastructure as code provisioning tfswitch - Switch Terraform versions easily (warrensbox/tap/tfswitch) tree - Display directory structure visually wget - Command-line file downloader yq - YAML/JSON/XML processor and querying tool Cloud & Container Tools awscli - AWS Command Line Interface docker - Container platform and runtime gcloud - Google Cloud CLI helm - Kubernetes package manager k9s - Interactive Kubernetes resource viewer and manager kubectl - Kubernetes command-line tool kubectx - Switch between Kubernetes clusters and namespaces minikube - Run Kubernetes locally in a VM Development Languages & Frameworks django - Python web framework go - Go programming language nvm - Node.js version manager npm - Node Package Manager pytorch - Machine learning framework for deep learning rbenv - Ruby version manager rust - Rust programming language tensorflow - ML library for machine learning and AI DevOps & Infrastructure Tools ansible - Configuration management and automation consul - Service mesh and service discovery hashicorp/tap/vault - Secrets management tool packer - Machine image builder prometheus - Metrics collection and monitoring System & Network Tools bottom - System monitor (process, memory, disk, network) dust - Disk usage analyzer (better than du) exa - Modern ls replacement with colors and icons fd - Fast find alternative lnav - Log file analyzer and explorer mtr - Network diagnostic combining ping and traceroute speedtest-cli - Test internet upload/download speed tldr - Simplified man pages with practical examples File & Directory Tools midnight-commander - Full-screen file manager (mc) ncdu - Disk space usage analyzer ranger - Terminal file manager with preview support Productivity & Utilities direnv - Load environment variables based on directory httpie - HTTP CLI client (curl alternative) jupyter - Interactive notebooks for data science navi - Interactive cheatsheet and command browser task - Task management and todo app tmux - Terminal multiplexer (multiple sessions/panes) Database & Data Tools postgresql - PostgreSQL database client redis-cli - Redis key-value store client sqlite - Lightweight embedded database Additional Utilities neofetch - System information display snappy - Compression library for fast compression/decompression youtube-dl - Download videos from YouTube and other sites Related Pages Mac Applications & Utilities

April 4, 2026 · 2 min · James M

Mac Applications & Utilities

Productivity & Writing Microsoft 365 💰 - Suite of office applications Excel - Spreadsheet application OneNote - Digital note-taking Outlook - Email & calendar management Powerpoint - Presentation software Word - Document writing Notion 💰 - All-in-one workspace for notes, databases, and project management Obsidian 💰 - Private markdown-based writing and knowledge management app MindNode 💰 - Mind mapping and brainstorming tool Development & Version Control PyCharm 💰 - Comprehensive Python IDE with debugging and testing tools GitKraken 💰 - Powerful visual Git client with integrated workflows iTerm2 🆓 - Advanced terminal emulator with split panes and extensive customization FileZilla 🆓 - FTP, FTPS & SFTP client for file transfer Kaleidoscope 💰 - Visual diff tool for comparing text, images, and folders VisualDiffer 💰 - Advanced folder & file comparison utility File & System Management Path Finder 💰 - Advanced file manager with extended functionality The Unarchiver 🆓 - Open any archive format (ZIP, RAR, 7z, etc.) CleanMyMac 💰 - System cleanup and optimization utility Disk Space Analyzer Pro 💰 - Visualize and reclaim disk space DiskCatalogMaker 💰 - Create and manage disc catalogs DirEqual 💰 - Compare and sync folder contents CloudMounter 💰 - Mount cloud storage (Dropbox, Google Drive, OneDrive, S3) as local drives Google Drive 🆓 - Cloud storage and file sync OneDrive 🆓 - Microsoft cloud storage integration Text & Data Tools TextSoap 💰 - Batch text transformations and cleanup Text Workflow 💰 - Automation engine for text manipulation Easy Data Transform 💰 - Data merging, splitting, cleaning without coding Pure Paste 💰 - Clipboard manager that pastes as plain text by default Screenshot & Media CleanShot 💰 - Professional screenshot and screen recording tool Loom 🆓 - Screen recording and video messaging VLC 🆓 - Universal media player supporting all formats OmniPlayer Pro 💰 - Advanced audio and video player Communication & Collaboration Slack 💰 - Team messaging and collaboration platform Teams 💰 - Microsoft unified communications platform Otter 💰 - AI-powered voice transcription System Utilities Alfred 💰 - Productivity launcher with hotkeys, snippets, and workflows Amphetamine 💰 - Keep-awake utility to prevent sleep LastPass 💰 - Password manager with secure autofill NordVPN 💰 - VPN for privacy and security Virtualization & System Extension Parallels 💰 - Run Windows, Linux, or other OS alongside macOS iPhone Apps Just Press Record 💰 - Recording and transcription with iCloud sync Otter 💰 - Voice-to-text transcription Legend: 🆓 = Free | 💰 = Paid/Freemium ...

April 4, 2026 · 2 min · James M

DevOps Explainers

APIs 9 types of API testing Explaining 9 types of API testing. The method to download the high-resolution PDF is available at the end. 🔹 Smoke Testing This is done after API development is complete. Simply validate if the APIs are working and nothing breaks. 🔹 Functional Testing This creates a test plan… pic.twitter.com/SIsERpQVX9 — Alex Xu (@alexxubyte) October 26, 2023 API vs SDK API Vs SDK! API (Application Programming Interface) and SDK (Software Development Kit) are essential tools in the software development world, but they serve distinct purposes: API: An API is a set of rules and protocols that allows different software applications and services… pic.twitter.com/cclxtknqRu ...

December 16, 2023 · 2 min · James M

DevOps Best Practices

Microservices 9 best practices for developing Microservices A picture is worth a thousand words: 9 best practices for developing microservices. When we develop microservices, we need to follow the following best practices: 1. Use separate data storage for each microservice 2. Keep code at a similar level of maturity 3. Separate build… pic.twitter.com/Qjdmlf2kdY — Bytebytego (@bytebytego) October 29, 2023 What tech stack is commonly used for Microservices ? What tech stack is commonly used for microservices? Below you will find a diagram showing the microservice tech stack, both for the development phase and for production. ▶️ 𝐏𝐫𝐞-𝐏𝐫𝐨𝐝𝐮𝐜𝐭𝐢𝐨𝐧 🔹 Define API - This establishes a contract between frontend and backend. We… pic.twitter.com/Gnwhwxlxy7 ...

December 16, 2023 · 1 min · James M

DevOps Cheatsheets

Cloud Computing A handy cheat sheet for the most popular cloud services (2023 edition). The method to download the high-resolution PDF is available at the end. What’s included? - AWS, Azure, Google Cloud, Oracle Cloud, Alibaba Cloud - Cloud servers - Databases - Message queues and streaming… pic.twitter.com/CX1pl6ueET — Alex Xu (@alexxubyte) December 15, 2023

December 16, 2023 · 1 min · James M

AWS Summit London (2023) - Videos

Keynote Speakers Tanuja Randery - Managing Director, EMEA - AWS Swami Sivasubramanian - VP for Databases, Analytics, AI & ML - AWS Renee Hunt - Chief Technology Officer - Compare the Market Will Cavendish - Global Digital Services Leader - Arup

June 7, 2023 · 1 min · James M

AWS Summit London (2023) - Agenda

Code Item Level AIM201 Building a data science platform on AWS to help Britain achieve net zero 200 - Intermediate AWS AIM202 Data-Driven Success: How INEOS Grenadiers Cycling Team Leverages No-code ML for Competitive Advantage 200 - Intermediate AWS AIM203 The AI Revolution: How Large Language Models are Shaping the Future 200 - Intermediate AWS AIM204 How Aviva built a scalable, secure and reliable MLOps platform on AWS 200 - Intermediate AWS AIM205 Solving global sustainability challenges using Geospatial ML with Amazon SageMaker 200 - Intermediate AWS AIM206 Transform your Enterprises with Generative AI industry accelerators 200 - Intermediate AWS AIM207 Accelerate Enterprise transformation with Amazon Kendra and LLMs 200 - Intermediate AWS AIM301 Implement MLOps Best Practices with Amazon SageMaker 300 - Advanced AWS AIM302 How to create delightful conversational experiences using Amazon Lex 300 - Advanced AWS AIM303 AWS DeepRacer: Get hands-on with machine learning 300 - Advanced AWS AIM304 AWS DeepRacer: Get hands-on with machine learning 300 - Advanced AWS AIM305 Unlock insights into your data with Amazon SageMaker Low Code No Code - Usage Patterns and Show Cases 300 - Advanced AWS ANA101 Beauty Bay and BJSS Make over Customer Experience using AWS 100 - Introductory AWS ANA102 Democratising Data at Direct Line Group 100 - Introductory AWS ANA201 Scaling Insights and Data-Driven Culture: a Modern Data Architecture Implementation 200 - Intermediate AWS ANA202 How Motability Operations built a Connected Vehicles Platform on AWS 200 - Intermediate AWS ANA203 Stages of a Data & Analytics Driven Startup 200 - Intermediate AWS ANA204 How Holland & Barrett built a “3-Michelin Star” data platform on an AWS modern data architecture to power insights at the speed of thought 200 - Intermediate AWS ANA205 Privacy-enhanced collaboration with AWS Clean Rooms 200 - Intermediate AWS ANA301 Running mission critical workloads on Amazon Redshift 300 - Advanced AWS ANA302 Building an Enterprise Data & Analytics Platform in AWS From 1 to 100 teams ARC302 Patterns and practices for building resilient applications 300 - Advanced AWS ARC303 Verify priority architecture characteristics to design well-architected applications 300 - Advanced AWS BIZ101 How Amazon Connect is helping deliver exceptional CX to Community Fibre, London’s biggest, fastest 100% full fibre broadband company 100 - Introductory AWS BIZ102 Contact Centre enabling Digital Transformation at speed with Amazon Connect and AI/ML Services 100 - Introductory AWS BIZ103 Lower risks and optimize costs with AWS Supply Chain 200 - Intermediate AWS BIZ301 Proactively engage your customers with Amazon Connect, using ML to improve your customer experience 300 - Advanced AWS BSI201 Simplify the path from data to action with Amazon QuickSight 200 - Intermediate AWS CMP201 How Ably optimised its compute costs and performance with AWS Graviton 200 - Intermediate AWS CMP301 Migrating latency sensitive workload to AWS Region and edge services 300 - Advanced AWS CMP401 AWS Inferentia2 – Making Generative AI predictions faster than ever 400 - Expert AWS COP201 Best practices for implementing observability in a modern application 200 - Intermediate AWS COP202 Cost Optimization as Culture 200 - Intermediate AWS COP203 How to implement AWS cost optimization strategy that works 200 - Intermediate AWS COP301 Unlocking Application Visibility with AWS Observability Tools 200 - Intermediate AWS DAT201 How to manage a Managed Service – A journey of ElastiCache at scale 200 - Intermediate AWS DAT301 Migrating Deliveroo’s Dispatcher Service to Amazon DynamoDB 300 - Advanced AWS DAT302 Amazon DynamoDB: Peeling the onion 300 - Advanced AWS DEV201 Maximizing Developer Productivity with Amazon CodeWhisperer 200 - Intermediate AWS DEV202 Catalyzing software development with Amazon CodeCatalyst 200 - Intermediate AWS DEV301 A deployment is not a release: Control your launches w/ feature flags 300 - Advanced AWS DEV302 Architecting multi-tenant SaaS workloads on AWS 300 - Advanced AWS DOP301 Create Modern and Sustainable Apps with Amazon CodeGuru 300 - Advanced AWS DOP302 Database DevOps on AWS: The Forgotten Automation 300 - Advanced AWS ENT201 Data Centre Migration to AWS & Navigating AWS Partner Programmes with Vitality Health 200 - Intermediate AWS ENT202 Cost as a Proxy for Sustainable Outcomes 200 - Intermediate AWS ENU201 Build and Grow your ClimateTech Startup at AWS 200 - Intermediate AWS EUC301 Picking the right AWS EUC service for your needs 300 - Advanced AWS FSI102 How NatWest and AWS worked together to boost personalised insight generation: A machine learning approach to transaction categorisation 100 - Introductory AWS FSI201 Amazon EKS production grade Kubernetes GMD-1 AWS GameDay - F1 League 2023 200 - Intermediate AWS GMD-3 AWS GameDay - New Frontier GameDay Challenge with LaunchDarkly 200 - Intermediate LaunchDarkly HLC101 Introducing artificial intelligence into IVF laboratories 100 - Introductory AWS IOT201 Scaling Connected Smart Homes with AWS 200 - Intermediate AWS IOT301 Building an IoT SuperNetwork on top of the AWS Global Infrastructure 300 - Advanced AWS ISV-01 Mega trends in SaaS 200 - Intermediate AWS ISV-02 The investor perspective on software 200 - Intermediate AWS ISV-03 Applying the power of AI Responsibly and Effectively within the Enterprise 200 - Intermediate AWS ISV-04 Delivering value via data monetisation 200 - Intermediate AWS KUB201 Accelerating your Kubernetes journey with Amazon EKS Blueprints 200 - Intermediate AWS KUB301 How Skyscanner Built a Resilient k8s Platform on EC2 Spot/EKS and Saved 73% of Their Cloud Spend 300 - Advanced AWS MGR201 Thinking Asynchronously: application integration patterns for microservices 200 - Intermediate AWS MGR202 Genius Sports: Migrating and modernising to a scalable cloud architecture 200 - Intermediate AWS MKT201 Digital Supply Chain Marketplaces, a gamechanger? 200 - Intermediate AWS MKT202 Modernize and govern your digital supply chain with AWS Marketplace 200 - Intermediate AWS NEA202 How AWS is making quantum technologies a practical reality 200 - Intermediate AWS NEA301 Quickly design and build serverless applications on AWS 300 - Advanced AWS NET201 Simplify and scale your hybrid global networking with AWS 200 - Intermediate AWS NET301 The power of cloud network innovation 300 - Advanced AWS OPN301 Speeding up the development of Containerized Applications 300 - Advanced AWS PAR-01 Streamlined AI/ML via Snowflake and Sagemaker 200 - Intermediate Snowflake PAR-02 Bridging the Gap Between Security and Development Teams in Less Than 7-minutes 100 - Introductory Trend Micro PAR-03 Building A Log Strategy So You Can Sleep Better at Night 200 - Intermediate Datadog PAR-04 How great leaders adapt to change with a Cloud-First mindset 100 - Introductory Deliotte PAR-05 Pending 100 - Introductory Reply PAR-06 How to secure your workloads from Ransomware attacks - VMware Cloud Disaster Recovery 100 - Introductory VMware PAR-07 Securing Applications from Code to Cloud with Prisma Cloud 100 - Introductory Palo Alto Networks PAR-08 Modernize faster with serverless and end-to-end observability 100 - Introductory Dynatrace PAR-09 Peeling the onion of Cloud Costs to achieve true business transformation 100 - Introductory Apptio PAR-10 Reducing the Fear of Releases and Technology Migrations 200 - Intermediate LaunchDarkly PAR-11 Intelligent Automation is nothing if it isn’t human-first 100 - Introductory Accenture PAR-12 How Wiz helps esure take a modern approach to cloud security 100 - Introductory Wiz PAR-13 Scaling Mobile Apps & Simplifying Payment Infrastructure to Enable Perfect Holidays 100 - Introductory MongoDB PAR-14 Securing Cloud Native Applications 100 - Introductory Snyk PS100 What’s next? Future tech trends for Public Sector 200 - Intermediate AWS PS101 Cloud-powered science: How UK research organisations are using the AWS Cloud to fuel scientific innovation. 200 - Intermediate AWS PS102 Accelerating datadriven transformation with AWS Modern Data Platform in-a-box 100 - Introductory AWS PS103 AWS Well-Architected for Secure, Sustainable, CostEffective Systems in Public Sector 200 - Intermediate AWS PS104 AWS legacy transformation methodology: Accelerating public sector modernisation 100 - Introductory AWS PS105 Transforming Customer Service with Amazon Connect: A Case Study of Citizens Advice 100 - Introductory SEC201 MoneySuperMarket journey to modernise customer identity solution with Amazon Cognito 200 - Intermediate AWS SEC202 Threat detection and incident response on AWS 200 - Intermediate AWS SEC203 Secure access to your internal applications on AWS with Zero Trust 200 - Intermediate AWS SEC301 Defending your Serverless App against the OWASP top 10 300 - Advanced AWS SER201 Small Teams, Big Ideas: Empowering Microservices with Serverless Architecture 200 - Intermediate AWS SER202 Building modern API architectures: Which front door should I use? 200 - Intermediate AWS SER301 Designing and deploying cloudoptimized Java applications 300 - Advanced AWS SER302 Adopting AWS serverless in your organisation 300 - Advanced AWS SER303 Refactoring to serverless 300 - Advanced AWS SER304 Building lowcode applications with serverless workflows 300 - Advanced AWS STG101 Optimising cost and performance of your data lake on Amazon S3 100 - Introductory AWS STG201 How to understand and improve the resiliency of your AWS applications 200 - Intermediate AWS STG301 Building ARMs Cost optimized Data Platform in AWS 300 - Advanced AWS SUS101 Decarbonising digital products & scaling sustainable innovation 100 - Introductory AWS SUS201 Architecting for Sustainability 200 - Intermediate AWS SUS301 How Channel 4 Optimize for Sustainability with AWS Well-Architected 300 - Advanced AWS SUS302 Carbon emissions reporting using AWS Modern Data Architecture 300 - Advanced AWS

June 7, 2023 · 8 min · James M

List of DevOps GitHub Projects

DevOps & Site Reliability Engineering (SRE) Awesome Scalability - reading list for illustrating the patterns of scalable, reliable, and performant large-scale systems Awesome Site Reliability Engineering - curated list of awesome Site Reliability and Production Engineering resources DevOps Exercises - contains questions and exercises on technical topics related to DevOps and SRE DevOps Resources - useful resources and information regarding DevOps including a learning roadmap DevOps Roadmap 2023 - step-by-step guide on how to become a DevOps engineer DevOps Tools - GitHub collection of DevOps tools How they SRE - curated collection of publicly available resources about SRE Kubernetes k9s - terminal UI to interact with your Kubernetes clusters kOps - helps you create, destroy, upgrade & maintain a production-grade, highly available, Kubernetes cluster KoPylot - open-source AI-powered Kubernetes assistant to help developers & DevOps engineers easily manage & monitor their Kubernetes clusters kube-state-metrics (KSM) - simple service that listens to the Kubernetes API server and generates metrics about the state of the objects Kubernetes Dashboard - general purpose, web-based UI for Kubernetes clusters Kubespray - Kubernetes cluster lifecycle management minikube - implements a local Kubernetes cluster on macOS, Linux, and Windows for you to practice and learn Popeye - scans a live Kubernetes cluster and reports potential issues with deployed resources and configurations Linux bat - a cat clone with syntax highlighting and Git integration pueue - command-line task management tool for sequential and parallel execution of long-running tasks specctl - command-line based tool to extract and transform Kubernetes objects to ECS and vice versa Test your SysAdmin skills - interview questions and answers for system administration Scheduling Airflow - platform to programmatically author, schedule, and monitor workflows dkron - distributed, fault tolerant job scheduling system for cloud native environments

May 29, 2023 · 2 min · James M
Next  »
© 2026 jamesm.blog · Powered by Hugo & PaperMod