#data-processing
#data-processing

Lawmakers seek to probe AI's environmental impacts

Democratic lawmakers have introduced a new bill that aims to assess and mitigate the environmental impacts of AI technologies.

The bill would require the EPA to conduct an assessment on the environmental impacts caused by AI, while NIST would convene a consortium and create a reporting system.

Lawmakers are concerned that the demand for data processing centers to train AI algorithms will contribute to pollution and greenhouse gas emissions. [ more ]

moreai

edge-computing

Theregister

IBM brings Power 10 servers to bear on AI edge deployments

IBM unveiled Power 10 servers for AI processing at the network edge, emphasizing high-threaded workloads and reduced latency by processing data on-site. [ more ]

ComputerWeekly.com

Securing the edge: A new battleground in mobile network security | Computer Weekly

The global edge computing market is growing rapidly, promising to revolutionize mobile networks across industries by enabling faster response times and more efficient data processing. [ more ]

DevOps.com

Edge Computing Requires DevOps at Scale - DevOps.com

Edge computing drives IT convergence

Data processing at edge requires new storage approach

Multi-protocol storage enables modernization [ more ]

Axios

AI drives explosion in edge computing

AI driving demand for edge computing infra

Edge computing bridges 5G and cloud services [ more ]

Lightbend

Akka Edge: Shaping the Future of Industry with Edge Computing | @lightbend

Akka Edge is an enhancement to the Akka ecosystem specifically designed for edge computing.

Akka Edge enables developers to leverage Akka's capabilities in diverse environments without adding complexities typically associated with brokered systems. [ more ]

ReadWrite

ChatGPT's 'hallucination' issue hit with privacy complaint

OpenAI ChatGPT AI chatbot disseminated inaccurate information, leading to an EU privacy complaint by NOYB against OpenAI's data processing practices. [ more ]

TechCrunch

Privacy professionals

Worldcoin hit with temporary ban in Spain over privacy concerns | TechCrunch

Spanish data protection authority orders Worldcoin to stop processing personal data in Spain due to GDPR violations.

The GDPR empowers data protection authorities to stop unlawful data processing if people's rights are at risk. [ more ]

Iapp

EU data protection

EDPB kicks off right of access coordinated enforcement action

Review of compliance with access rights under GDPR by European Data Protection Board

Thirty-one data protection authorities participating in EDPB's enforcement action. [ more ]

moregdpr

New York Post

Microsoft readies new AI model to compete with Google, ChatGPT owner OpenAI: report

Microsoft is developing a new AI language model, MAI-1, to compete with Google and OpenAI. [ more ]

Iapp

2 weeks ago

A regulatory roadmap to AI and privacy

AI technologies are enhancements of existing technologies; privacy issues in AI are extensions of traditional privacy concerns, requiring a holistic approach to regulation. [ more ]

ComputerWeekly.com

AI firm saves a million in shift to Pure FlashBlade shared storage | Computer Weekly

Crater AI consultancy saved CAN$1.5m with FlashBlade array, reducing time configuring storage for AI projects. [ more ]

TechCrunch

Mobile OS maker Jolla is back and building an AI device | TechCrunch

Private cloud and AI router for adaptive digital assistant

Focus on privacy and security in AI device development [ more ]

Iapp

Strategies to ensure compliance with global data minimization requirements

Enforcement of data minimization requirements is increasing globally. [ more ]

Nature

2 weeks ago

85 million cells - and counting - at your fingertips

Biologists struggle with integrating single-cell gene-expression data from various sources for analysis. [ more ]

Medium

Optimizing Resource Allocation and Parallel Processing for 20GB Spark Jobs

Optimizing resource allocation based on data volume and processing speed is crucial for efficient job completion. [ more ]

CodeProject

Sorting and Removing Elements from the Structure of Arrays (SOA) in C++

Storing coordinates as a Structure of Arrays (SOA) is efficient for GPU computing due to optimal memory throughput.

When dealing with large amounts of data in SOA format, rearranging data can be inefficient, leading to challenges in processing on CPUs. [ more ]

Realpython

Python

Flattening a List of Lists in Python - Real Python

Flattening nested lists in Python is a common operation when working with multidimensional data. [ more ]

TeachPrivacy

Privacy professionals

Murky Consent: An Approach to the Fictions of Consent in Privacy Law - FINAL VERSION

Privacy consent in law is often fictitious, and focusing on acknowledging and managing these fictions is more beneficial than trying to turn them into truths. [ more ]

New York Post

Privacy professionals

Facebook parent Meta targeted in privacy complaints by EU consumer groups

Meta Platforms faced privacy complaints from EU consumer groups on data collection breaches.

Consumer groups in eight countries cited GDPR violations related to data processing by Meta. [ more ]

MarTech

Marketing

What does 'Real-Time Marketing' really mean? | MarTech

Real-time marketing is about delivering information when the end user needs it, not necessarily immediately. [ more ]

Medium

how to fill null values and drop null values in pyspark,sql and scala

Handling null values involves filling specified values and dropping rows/columns with null values in PySpark, SQL, and Scala. [ more ]

Medium

Efficient Scala BiqQuery Data Retrieval: A Comprehensive Guide

You can use the spark-bigquery connector to read data from BigQuery tables directly into Spark DataFrames.

It is essential to set GCP credentials, specify the table path correctly, and include necessary dependencies to connect with BigQuery. [ more ]

Medium

Unlocking Spark's Hidden Power: The Secret Weapon of Caching Revealed in a Tale of Bug Hunting and...

Caching in Apache Spark is essential for improving performance by storing intermediary results in memory and reusing them instead of recalculating them from scratch.

Caching can also prevent inconsistencies caused by non-deterministic functions, such as the UUID function, by ensuring that the same results are used consistently across different operations. [ more ]

Medium

4 months ago

Streamlining Java: A Practical Guide to findFirst() and findAny()

Java Streams offer a modern approach to processing sequences of data in Java programming.

Streams facilitate declarative programming and enable developers to express complex data processing queries without getting bogged down in the mechanics of iteration. [ more ]

Medium

6 months ago

Spark Tutorial: Master the Essential Skills for Data Engineering and Data Science

Spark has become the defacto tool for big data processing.

Understanding and mastering Spark is crucial for data engineering and data science job interviews. [ more ]

Iapp

EU data protection

Finland's DPA issues guidance on the positive credit information register

The Office of the Data Protection Ombudsman in Finland issued guidance on the positive credit information register.

Residents in Finland cannot refuse the processing of their data or request its deletion in the positive credit information register. [ more ]

Washington Post

Education

As colleges receive FAFSA records, some ask: 'How do we trust this data?'

Colleges facing technical problems with FAFSA data processing

Concerns about accuracy and delays in financial aid processing [ more ]

TechCrunch

New geospatial data startup streamlines satellite imagery visualization | TechCrunch

Geospatial data processing requires significant engineering prowess

Fused platform offers fast data processing and visualization capabilities [ more ]

Iapp

EDPB publishes GDPR one-stop-shop digest

The European Data Protection Board has published a guide to EU General Data Protection Regulation (GDPR) one-stop-shop cases.

The guide covers enforcement actions under Articles 32, 33, and 34 of the GDPR, providing insights into how DPAs have interpreted and applied GDPR provisions in various scenarios. [ more ]

Iapp

Belgium's DPA fines data management company

Belgium's Data Protection Authority has fined Black Tiger Belgium 174,640 euros for violating data protection regulations.

Black Tiger Belgium was found to not be transparent about its data processing of personal data. [ more ]

InfoQ

4 months ago

Netflix Creates Incremental Processing Solution Using Maestro and Apache Iceberg

Netflix created a new solution for incremental processing in its data platform using Maestro and Apache Iceberg.

The solution reduces cost and execution time by avoiding processing complete datasets and capturing change ranges for specified data fields. [ more ]

Iapp

4 months ago

Blog: Data processing concerns with ChatGPT

OpenAI's ChatGPT data processing standards are the subject of a GDPR complaint

The complaint alleges that ChatGPT ignores GDPR provisions regarding data processing [ more ]

Cloud Pro

6 months ago

Google Cloud unveils UK data residency options for Vertex AI customers

Vertex AI customers can now keep their data closer to home

CodeProject

Web design

How To Implement The Pipeline Design Pattern in C#

The pipeline design pattern in C# optimizes data processing by breaking it down into stages executed in parallel, reducing processing time.

It simplifies complex operations, enhances scalability, and makes it easier to handle large datasets by breaking down data processing into source, stages, and sink components. [ more ]

TechCrunch

Startup companies

Artie helps companies put data to work faster with real time syncing | TechCrunch

Artie wants to solve the problem of lag in using data by efficiently moving it from databases to data warehouses.

Artie uses Change Data Capture (CDC) and stream processing to perform data syncs in a reliable and efficient way, resulting in low latency and optimized compute costs. [ more ]

Medium

UX design

Streamlining chaos: Redesign of a complex Workflow canvas

Understanding the concept of a workflow and its role in organizing tasks and achieving goals.

The ETL workflow focuses on extracting, transforming, and loading data for efficient analysis and use. [ more ]

ComputerWeekly.com