Data Engineering Resources

How To Validate Archives and Identify Invalid Documents in Java

Explore the prevalence of cyberattacks carried out using common archive formats and invalid document types and data validation API solutions.

September 16, 2023

by Brian O'Neill

CORE

· 6,726 Views · 2 Likes

AI for Web Devs: Project Introduction and Setup

In this post, begin bootstrapping a web development project using Qwik and get things ready to incorporate AI tooling from OpenAI.

September 16, 2023

by Austin Gil

CORE

· 6,367 Views · 5 Likes

Unraveling Lombok's Code Design Pitfalls: Exploring Encapsulation Issues

Lombok simplifies Java coding but can breach encapsulation. Java 8's Objects.requireNonNull and IDE support are alternatives. Choose wisely.

September 16, 2023

by Otavio Santana

CORE

· 10,865 Views · 8 Likes

A Complete Guide to Open-Source LLMs

Unlock the world of open-source Large Language Models (LLMs) with this comprehensive guide, and embrace the power of collaborative AI in your projects.

September 15, 2023

by Hiren Dhaduk

· 6,705 Views · 1 Like

Top Five AI-Powered Tools for Test Automation

Top 5 AI-Powered Tools for Test Automation: Perfecto Scriptless Mobile, Applitools, Functionize, AccelQ, Testim. Read more about the pros and cons of AI tools.

September 15, 2023

by Anna Boiko

· 5,681 Views · 1 Like

Enhancing Hyperparameter Tuning With Tree-Structured Parzen Estimator (Hyperopt)

This article explores the concept of Tree-Structured Parzen Estimator (TPE) for hyperparameter tuning in machine learning and its application with an example.

September 15, 2023

by Sai Nikhilesh Kasturi

· 4,212 Views · 1 Like

Beyond the Prompt: Unmasking Prompt Injections in Large Language Models

Prompt Injections in Large Language Models - Uncovering the essence of prompt injections within LLMs, unraveling their execution, and examining strategies for prevention.

September 15, 2023

by Tushar Chugh

· 3,660 Views · 3 Likes

REST vs. Message Brokers: Choosing the Right Communication

We’ll delve into the disparities between REST and message brokers in terms of communication, helping you make the right choice for your specific use case.

September 15, 2023

by Shoham Roditi Elimelech

· 14,033 Views · 9 Likes

Application Integration for IoT Devices: A Detailed Guide To Unifying Your Ecosystem

Know how the IoT connects to application integration in this continuously growing and innovating world, and learn IoT strategies to always be up to date.

September 15, 2023

by Pamela Price

· 4,547 Views · 3 Likes

Unraveling LLMs' Full Potential, One Token at a Time With LangChain

LLMs have immense potential across various tasks and domains; however, they may miss the mark on perfection. Add LangChain to the mix and witness heightened capabilities.

September 15, 2023

by Taranjeet Singh

· 3,751 Views · 1 Like

Apache Flink

This tutorial will show you step-by-step how to use Astra as a sink for results computed by Apache Flink, an open-source framework.

September 15, 2023

by Patrick McFadin

· 5,277 Views · 1 Like

Next-Gen Threat Hunting Techniques With SIEM-SOAR Integration

NLP, AI, and ML boost cybersecurity via streamlined data processing, automated incident handling, compliance, and proactive threat detection.

September 15, 2023

by Cheena Shekhawat

· 3,180 Views · 1 Like

Microservices With Apache Camel and Quarkus (Part 5)

After learning how to run our microservices in Minikube in part three of this series, let's look at how to do the same in OpenShift.

September 15, 2023

by Nicolas Duminil

CORE

· 9,179 Views · 7 Likes

Snowflake vs. Data Bricks: Compete To Create the Best Cloud Data Platform

Do you want to get into the race for the best cloud data platform? Take a look at the difference between Snowflake and Data Bricks.

September 15, 2023

by Sanam Naseem

· 4,086 Views · 4 Likes

Messaging Channels in Enterprise Integration Patterns: Enabling Efficient Communication

In this article, we will discuss Messaging Channels in Enterprise Integration Patterns along with the types and their benefits.

September 15, 2023

by Aditya Bhuyan

· 2,834 Views · 2 Likes

What Is Privacy by Design?

Privacy by Design is sometimes considered too abstract. We, therefore, share tips and tactics for engineers to implement each of the seven principles.

September 15, 2023

by Xander W

· 2,612 Views · 1 Like

Mastering Persistence: Why the Persistence Layer Is Crucial for Modern Java Applications

Ignoring the persistence layer in software can cause data problems, slow performance, maintenance issues, and limited adaptability. It's vital for secure, efficient, and flexible applications.

September 15, 2023

by Otavio Santana

CORE

· 8,464 Views · 2 Likes

A Better Web3 Experience: Account Abstraction From Flow (Part 1)

Walletless dApps from Flow use account abstraction to improve the web3 user experience. In part one, we walk through how to build the backend for this dApp.

September 15, 2023

by Alvin Lee

CORE

· 4,126 Views · 2 Likes

Log Analysis: How to Digest 15 Billion Logs Per Day and Keep Big Queries Within 1 Second

This article describes a large-scale data warehousing use case to provide reference for data engineers who are looking for log analytic solutions.

September 15, 2023

by Zaki Lu

· 4,210 Views · 3 Likes

How To Use ChatGPT With Python

Are you looking forward to knowing how you can empower ChatGPT with Python? Learn step-by-step how to set up an account in the Kommunicate platform using Python.

September 14, 2023

by Devashish Mamgain

· 2,717 Views · 1 Like

The Latest Data Engineering Topics