#docker

[ follow ]
#python

Exploring Spark and Airflow Integration for Submitting Python and Scala Jobs

Exploring Apache Spark and Airflow integration for job orchestration in Python and Scala.

Deep Dive into Data Apps with Streamlit | HackerNoon

Streamlit allows rapid development of interactive web applications for data science with minimal coding required.

Episode #222: Using Virtual Environments in Docker & Comparing Python Dev Tools - The Real Python Podcast

Using Python virtual environments in Docker replicates local development practices, enhancing code isolation and simplifying project management.

Back to the future, destination 3.14

Python 3.14.0 alpha 1 introduces significant new features and improvements, laying the groundwork for its release.

Production-ready Python Docker Containers with uv

Efficient Docker workflows for Python are enhanced by uv 0.4.4 features like multi-stage builds and proper dependency management.

C will watch you in silence

Python virtual environments are crucial for maintaining project dependencies, especially when using Docker.

Exploring Spark and Airflow Integration for Submitting Python and Scala Jobs

Exploring Apache Spark and Airflow integration for job orchestration in Python and Scala.

Deep Dive into Data Apps with Streamlit | HackerNoon

Streamlit allows rapid development of interactive web applications for data science with minimal coding required.

Episode #222: Using Virtual Environments in Docker & Comparing Python Dev Tools - The Real Python Podcast

Using Python virtual environments in Docker replicates local development practices, enhancing code isolation and simplifying project management.

Back to the future, destination 3.14

Python 3.14.0 alpha 1 introduces significant new features and improvements, laying the groundwork for its release.

Production-ready Python Docker Containers with uv

Efficient Docker workflows for Python are enhanced by uv 0.4.4 features like multi-stage builds and proper dependency management.

C will watch you in silence

Python virtual environments are crucial for maintaining project dependencies, especially when using Docker.
morepython

Thread and Heap Dumps in Docker Containers

A simple method exists to debug Docker applications using thread/heap dumps directly from the container.

Remove docker build cache

To resolve 'no space left' errors in Docker, clear the build cache using the appropriate command.

Reverse proxy in Traefik with subdirectories.

Traefik efficiently manages and distributes requests to Docker containers by processing them through entry points, routers, middleware, and services.

Docker tutorial: Get started with Docker volumes

Docker volumes enable effective data persistence for containerized applications, permitting the use of local file systems without compromising immutability.
#kubernetes

Can Wasm replace containers?

WebAssembly has potential applications beyond the browser, particularly in server environments, but it is unlikely to replace existing container solutions like Docker.

Composable Microservices: Deploying into K8 Cluster

Bit's platform starter provides boilerplate components and configuration to deploy Composable Microservices into Kubernetes.

How to Optimize Kubernetes for Large Docker Images | HackerNoon

The cluster upgrade led to excessive docker image pulls, causing high disk utilization and pod startup failures.

Building a Kubernetes Cluster from Scratch: A Detailed Guide

To set up a Kubernetes cluster, ensure at least three Ubuntu 20.04 LTS servers with internet access, and install necessary components.

Deploying Airflow on Kubernetes Using ArgoCD and Terraform: Modern GitOps approach | HackerNoon

Apache Airflow™ and GitOps are powerful tools for managing data manipulation workflows and operational management using Git repositories.

| My Tech Radar |21| Quick Start Series Let`s meet ArgoCd

Rancher Desktop and Podman Desktop are recommended as alternatives to Docker Desktop for Mac OS users.

Can Wasm replace containers?

WebAssembly has potential applications beyond the browser, particularly in server environments, but it is unlikely to replace existing container solutions like Docker.

Composable Microservices: Deploying into K8 Cluster

Bit's platform starter provides boilerplate components and configuration to deploy Composable Microservices into Kubernetes.

How to Optimize Kubernetes for Large Docker Images | HackerNoon

The cluster upgrade led to excessive docker image pulls, causing high disk utilization and pod startup failures.

Building a Kubernetes Cluster from Scratch: A Detailed Guide

To set up a Kubernetes cluster, ensure at least three Ubuntu 20.04 LTS servers with internet access, and install necessary components.

Deploying Airflow on Kubernetes Using ArgoCD and Terraform: Modern GitOps approach | HackerNoon

Apache Airflow™ and GitOps are powerful tools for managing data manipulation workflows and operational management using Git repositories.

| My Tech Radar |21| Quick Start Series Let`s meet ArgoCd

Rancher Desktop and Podman Desktop are recommended as alternatives to Docker Desktop for Mac OS users.
morekubernetes
#containerization

Comparative features of Docker Container Registries

Choosing the right Docker image registry is essential for efficient image management and distribution, impacting both small teams and large enterprises.

The Ultimate Guide to Docker: From Novice to Expert

Docker is an open-source platform that automates application deployment in containers, providing consistent behavior across environments.

The Ultimate Guide to Docker: From Novice to Expert

Docker revolutionizes application development and deployment through containerization, ensuring consistency across environments.

Deploy Your Own Web App With Kamal 2 Matt Layman

Kamal facilitates seamless deployment and management of web apps with Docker, supporting various technologies beyond just Rails.

Comparative features of Docker Container Registries

The efficient management and distribution of Docker images is crucial for organizations of all sizes, highlighting the importance of selecting the right Docker image registry.

Data Engineering Bootcamp 2024 (Week 1) Docker & Terraform | TypeThePipe

Docker is a crucial technology for containerization and application deployment.
A Dockerfile is a text document that defines the commands to build a Docker image and a Docker Compose is a tool for running multi-container Docker applications.

Comparative features of Docker Container Registries

Choosing the right Docker image registry is essential for efficient image management and distribution, impacting both small teams and large enterprises.

The Ultimate Guide to Docker: From Novice to Expert

Docker is an open-source platform that automates application deployment in containers, providing consistent behavior across environments.

The Ultimate Guide to Docker: From Novice to Expert

Docker revolutionizes application development and deployment through containerization, ensuring consistency across environments.

Deploy Your Own Web App With Kamal 2 Matt Layman

Kamal facilitates seamless deployment and management of web apps with Docker, supporting various technologies beyond just Rails.

Comparative features of Docker Container Registries

The efficient management and distribution of Docker images is crucial for organizations of all sizes, highlighting the importance of selecting the right Docker image registry.

Data Engineering Bootcamp 2024 (Week 1) Docker & Terraform | TypeThePipe

Docker is a crucial technology for containerization and application deployment.
A Dockerfile is a text document that defines the commands to build a Docker image and a Docker Compose is a tool for running multi-container Docker applications.
morecontainerization
#cybersecurity

New Cryptojacking Attack Targets Docker API to Create Malicious Swarm Botnet

A new cryptojacking campaign targets the Docker Engine API, allowing attackers to utilize Docker Swarm for malicious operations.

Cybercriminals Exploiting Docker API Servers for SRBMiner Crypto Mining Attacks

Attackers are exploiting Docker remote APIs to deploy crypto miners and other malware, utilizing gRPC protocol over h2c to evade security measures.

New Cryptojacking Attack Targets Docker API to Create Malicious Swarm Botnet

A new cryptojacking campaign targets the Docker Engine API, allowing attackers to utilize Docker Swarm for malicious operations.

Cybercriminals Exploiting Docker API Servers for SRBMiner Crypto Mining Attacks

Attackers are exploiting Docker remote APIs to deploy crypto miners and other malware, utilizing gRPC protocol over h2c to evade security measures.
morecybersecurity
#big-data

End-to-End Data Engineer DATA LAKE Project (Scala Spark 3.5.1

Airflow helps schedule scripts for running during off-peak hours to handle large data volumes efficiently.

Quick Start Guide for DolphinScheduler: Installation and Configuration Using Docker Compose | HackerNoon

DolphinScheduler is a powerful tool for managing big data workflows, easily installed via Docker Compose.

End-to-End Data Engineer DATA LAKE Project (Scala Spark 3.5.1

Airflow helps schedule scripts for running during off-peak hours to handle large data volumes efficiently.

Quick Start Guide for DolphinScheduler: Installation and Configuration Using Docker Compose | HackerNoon

DolphinScheduler is a powerful tool for managing big data workflows, easily installed via Docker Compose.
morebig-data
#base-images

7 Tips to Optimize Your Dockerfile for Faster Builds and Smaller Images

Choose a lightweight base image to reduce final Docker image size and improve efficiency.
Utilize multi-stage builds in Dockerfiles to create smaller and optimized images.

Reduce the size of the Docker Image

Optimize Docker images by selecting minimal base images like Alpine or distroless.
Combine RUN commands in Dockerfiles to enhance image size and performance.

7 Tips to Optimize Your Dockerfile for Faster Builds and Smaller Images

Choose a lightweight base image to reduce final Docker image size and improve efficiency.
Utilize multi-stage builds in Dockerfiles to create smaller and optimized images.

Reduce the size of the Docker Image

Optimize Docker images by selecting minimal base images like Alpine or distroless.
Combine RUN commands in Dockerfiles to enhance image size and performance.
morebase-images

Portainer Plus Gitops: a Simple Way to Deploy and Manage Your Self-hosted Applications | HackerNoon

Docker simplifies self-hosting applications, enabling users to run containers without deep technical knowledge.

Run AI On YOUR Computer: NEW Llama 3.2 - Tutorial | HackerNoon

Llama 3.2 enables powerful local AI applications with enhanced text and image processing capabilities, prioritizing user privacy and low latency.
#containers

Comparing Docker and Podman: A Guide to Container Management Tools

Podman is a secure, daemonless alternative to Docker for container management, emphasizing user control and reducing vulnerabilities.

Docker for Developers: Understanding the Core Concepts

Docker streamlines application development, shipping, and operation across different environments, enhancing developer efficiency.

Comparing Docker and Podman: A Guide to Container Management Tools

Podman is a secure, daemonless alternative to Docker for container management, emphasizing user control and reducing vulnerabilities.

Docker for Developers: Understanding the Core Concepts

Docker streamlines application development, shipping, and operation across different environments, enhancing developer efficiency.
morecontainers
#deployment

Nginx subdirectory as root for React

Configure React app for nginx deployment by adjusting homepage and environment variables.
Modify nginx.conf for proper routing in a sub-directory setup.
Ensure Dockerfile is updated to reflect the sub-directory application structure.

Deploy next.js using pm2 cluster mode(and with docker)

Utilizing pm2 in cluster mode enhances the scalability of Next.js applications for handling increased traffic effectively.

Dockerize Play2 Web API with New Relic Integration

Smooth deployment and robust monitoring are important for delivering applications.
Docker and New Relic can help simplify deployment and provide insights into application performance.

Nginx subdirectory as root for React

Configure React app for nginx deployment by adjusting homepage and environment variables.
Modify nginx.conf for proper routing in a sub-directory setup.
Ensure Dockerfile is updated to reflect the sub-directory application structure.

Deploy next.js using pm2 cluster mode(and with docker)

Utilizing pm2 in cluster mode enhances the scalability of Next.js applications for handling increased traffic effectively.

Dockerize Play2 Web API with New Relic Integration

Smooth deployment and robust monitoring are important for delivering applications.
Docker and New Relic can help simplify deployment and provide insights into application performance.
moredeployment

Facts About the Differences Between localhost, 127.0.0.1, and host.docker.internal

localhost, 127.0.0.1, and host.docker.internal are critical for networking in web development and containers.

Optimizing Node.js Code Coverage With NYC in Docker Containers | HackerNoon

Running Node.js in Docker requires careful attention to signal handling and coverage reporting.

NixOS Hydra-Behind The Scenes with NixOS & Docker Images

Setting up NixOS is easy; no specific reason is needed for first-time installation.

More secure Python Docker images with Amazon Linux

Amazon Linux is preferred over Debian for Docker images due to enhanced security measures and optimizations for the AWS Cloud.

Guide: How to route Docker logs correctly in New Relic

Understanding the importance of proper container log management is crucial in the Docker and New Relic community.
New Relic infrastructure agent may lead to logs being aggregated together in the Host UI rather than categorizing them appropriately in the Container UI.

Docker Contexts: Simplifying Remote Operations

Docker context simplifies configuration and switching between contexts.
Benefits include executing commands on a remote server and using external authentication tools locally.

Simple self-hosted OpenStreetMap routing using Valhalla and Docker

Self-hosted routing using Valhalla and Docker is straightforward.
Download an OpenStreetMap extract, place it in a folder, and run a Docker command to start the routing service.

C# .NET Core Event Source with Martendb

MartenDB enables CRUD operations effortlessly
MartenDB showcases powerful Event Sourcing capabilities
#mailkit

Use MailKit and GreenMail to develop a robust email interaction

MailKit Integration ensures reliable connection with mail servers using SMTP, IMAP, and POP3.
GreenMail provides a lightweight, in-memory mail server solution for comprehensive email testing.

Use MailKit and GreenMail to develop a robust email interaction

The project combines MailKit for reliable email handling with GreenMail for comprehensive testing.
MailKit enables smooth communication with various mail servers through SMTP, IMAP, and POP3 protocols.

Use MailKit and GreenMail to develop a robust email interaction

MailKit Integration ensures reliable connection with mail servers using SMTP, IMAP, and POP3.
GreenMail provides a lightweight, in-memory mail server solution for comprehensive email testing.

Use MailKit and GreenMail to develop a robust email interaction

The project combines MailKit for reliable email handling with GreenMail for comprehensive testing.
MailKit enables smooth communication with various mail servers through SMTP, IMAP, and POP3 protocols.
moremailkit

Docker starts Testcontainers on ex-rival Red Hat's OpenShift

Lessons from Docker on pivoting in a changing reality
Importance of paying attention to developer consumption and feedback

PyCharm 2023.3.5 Is Out! | The PyCharm Blog

PyCharm 2023.3.5 is an important bug-fix update.
Notable fixes include issues with outdated project errors, Docker 2.25 support, macOS Sonoma 14.4 update crashes, and Linux screen scaling.

How to deploy software to Linux-based IoT devices at scale

IoT devices heavily rely on the Linux operating system for flexibility, robustness, and open-source nature.
Containerized deployment and centralized management are key best practices for deploying software on large fleets of Linux-based IoT devices.

Announcing Docker Build Cloud

Docker Build Cloud offers remote shared-cache and native builders for AMD64 and ARM64 CPU architectures.
Docker introduced Remote Builders as a solution to the slow emulation process when building images of different CPU architectures.

How to Dual Boot Ruby on Rails In Docker

Docker files added by default in Rails 7.1
FastRuby.io uses Dual Boot technique for upgrades in Docker

Provide weather details in a given place, and a decorative background of that location on demand

The Check the Vue weather application uses the Open Weather Map API and Open AI API to generate images of current weather in different locations.
The application is currently using web requests but the developer plans to move it to a docker image in the future to generate images server side.

Job Vacancy: Devops Engineer (part time, 80%) // iMusician Digital AG | IT / Software Development Jobs | Berlin Startup Jobs

iMusician is hiring a Devops Engineer for their team in Berlin
The role involves working closely with Customer Support and Marketing Operations teams

Rails on Docker without Docker

Some Rails developers are hesitant to use Docker due to the time it takes to install and learn it
Fly.io can gradually introduce Docker without affecting app development velocity

Docker Build Cloud aims to accelerate Docker builds

Docker Build Cloud is a cloud-based build service that speeds up Docker image builds for engineering teams.
The service offloads builds to the cloud, accelerating them up to 39x.

Docker's Build Cloud lets developers build their containers in the cloud | TechCrunch

Docker Build Cloud is a fully managed service that allows development teams to offload image builds to the cloud.
The service can speed up build times by up to 39x.

Ready, Set, Deploy! Rails 7.1 Gets Docker Support

Rails 7.1 introduces default Dockerfiles
The default Dockerfiles improve the development experience

Dublin dockers open up about lasting legacy of life at the port as new exhibition opens

Museum illustrates journey of the men who helped shape iconic part of the capital
Now, a new exhibition reflects on the careers of those who worked at the port.
from TechRepublic
1 year ago

The Top 5 Best Big Data Analytics Tools & Solutions for 2023

Running commands inside a Docker container can be easily done using the 'docker exec' command.
The 'docker exec' command allows you to enter a running container and execute commands as if you were inside the container itself.
[ Load more ]