DZone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Over 2 million developers have joined DZone.
Log In / Join
Refcards Trend Reports
Events Video Library
Over 2 million developers have joined DZone. Join Today! Thanks for visiting DZone today,
Edit Profile Manage Email Subscriptions Moderation Admin Console How to Post to DZone Article Submission Guidelines
View Profile
Sign Out
Refcards
Trend Reports
Events
View Events Video Library
Zones
Culture and Methodologies Agile Career Development Methodologies Team Management
Data Engineering AI/ML Big Data Data Databases IoT
Software Design and Architecture Cloud Architecture Containers Integration Microservices Performance Security
Coding Frameworks Java JavaScript Languages Tools
Testing, Deployment, and Maintenance Deployment DevOps and CI/CD Maintenance Monitoring and Observability Testing, Tools, and Frameworks
Culture and Methodologies
Agile Career Development Methodologies Team Management
Data Engineering
AI/ML Big Data Data Databases IoT
Software Design and Architecture
Cloud Architecture Containers Integration Microservices Performance Security
Coding
Frameworks Java JavaScript Languages Tools
Testing, Deployment, and Maintenance
Deployment DevOps and CI/CD Maintenance Monitoring and Observability Testing, Tools, and Frameworks

Integrating PostgreSQL Databases with ANF: Join this workshop to learn how to create a PostgreSQL server using Instaclustr’s managed service

Mobile Database Essentials: Assess data needs, storage requirements, and more when leveraging databases for cloud and edge applications.

Monitoring and Observability for LLMs: Datadog and Google Cloud discuss how to achieve optimal AI model performance.

Automated Testing: The latest on architecture, TDD, and the benefits of AI and low-code tools.

Related

  • Decoding Business Source Licensing: A New Software Licensing Model
  • Cutting Big Data Costs: Effective Data Processing With Apache Spark
  • Bayesian Optimization and Hyperband (BOHB) Hyperparameter Tuning With an Example
  • .NET Performance Optimization Techniques for Expert Developers

Trending

  • Unraveling Lombok's Code Design Pitfalls: Exploring Encapsulation Issues
  • Mastering Persistence: Why the Persistence Layer Is Crucial for Modern Java Applications
  • Microservices With Apache Camel and Quarkus (Part 5)
  • REST vs. Message Brokers: Choosing the Right Communication
  1. DZone
  2. Data Engineering
  3. AI/ML
  4. Machine Bias in Profiler-Based Optimization

Machine Bias in Profiler-Based Optimization

Oren Eini user avatar by
Oren Eini
·
Jan. 02, 14 · Interview
Like (0)
Save
Tweet
Share
6.28K Views

Join the DZone community and get the full member experience.

Join For Free

take a look at the following profilers results. they both showcase pretty much the same codebase, without any major changes in between. however, they have been both run on different machines, and they result in very different performance optimization paths.

main machine:

laptop:

image

as you can see, when running the code on my main machine, the most expensive thing is actually writing to disk (writetojournal). however, on my laptop, writing to disk is actually very cheap.  the likely reason is, again, my laptop is faking writing to disk in favor of buffering writes, even though we explicitly tell it not to. that means that it behaves as if it is we already optimized writing to disk. my main machine behaves more like a server, and we see a lot more i/o costs, which pretty much mask any other costs that we might have.

using the profiler to guide you with regards to how to optimize the system on any one of those machines would lead you in very different paths. with voron, we are testing it in a variety of scenarios, to make sure that we aren’t optimizing for one particular machine and hurting another.

optimization Machine

Published at DZone with permission of Oren Eini, DZone MVB. See the original article here.

Opinions expressed by DZone contributors are their own.

Related

  • Decoding Business Source Licensing: A New Software Licensing Model
  • Cutting Big Data Costs: Effective Data Processing With Apache Spark
  • Bayesian Optimization and Hyperband (BOHB) Hyperparameter Tuning With an Example
  • .NET Performance Optimization Techniques for Expert Developers

Comments

Partner Resources

X

ABOUT US

  • About DZone
  • Send feedback
  • Careers
  • Sitemap

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • Become a Contributor
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 3343 Perimeter Hill Drive
  • Suite 100
  • Nashville, TN 37211
  • support@dzone.com

Let's be friends: