DZone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Over 2 million developers have joined DZone.
Log In / Join
Refcards Trend Reports
Events Video Library
Over 2 million developers have joined DZone. Join Today! Thanks for visiting DZone today,
Edit Profile Manage Email Subscriptions Moderation Admin Console How to Post to DZone Article Submission Guidelines
View Profile
Sign Out
Refcards
Trend Reports
Events
View Events Video Library
Zones
Culture and Methodologies Agile Career Development Methodologies Team Management
Data Engineering AI/ML Big Data Data Databases IoT
Software Design and Architecture Cloud Architecture Containers Integration Microservices Performance Security
Coding Frameworks Java JavaScript Languages Tools
Testing, Deployment, and Maintenance Deployment DevOps and CI/CD Maintenance Monitoring and Observability Testing, Tools, and Frameworks
Culture and Methodologies
Agile Career Development Methodologies Team Management
Data Engineering
AI/ML Big Data Data Databases IoT
Software Design and Architecture
Cloud Architecture Containers Integration Microservices Performance Security
Coding
Frameworks Java JavaScript Languages Tools
Testing, Deployment, and Maintenance
Deployment DevOps and CI/CD Maintenance Monitoring and Observability Testing, Tools, and Frameworks

Integrating PostgreSQL Databases with ANF: Join this workshop to learn how to create a PostgreSQL server using Instaclustr’s managed service

Mobile Database Essentials: Assess data needs, storage requirements, and more when leveraging databases for cloud and edge applications.

Monitoring and Observability for LLMs: Datadog and Google Cloud discuss how to achieve optimal AI model performance.

Automated Testing: The latest on architecture, TDD, and the benefits of AI and low-code tools.

Related

  • A Brief Guide on How To Become an Efficient Prompt Engineer
  • Building and Sustaining an Open Source Community in the Context of Organizations
  • What Is a Modern Developer?
  • Cracking the Code: Machine Learning Unveils the Secrets of Fault Diagnosis and Root Cause Analysis

Trending

  • Log Analysis: How to Digest 15 Billion Logs Per Day and Keep Big Queries Within 1 Second
  • Breaking Down Silos: The Importance of Collaboration in Solution Architecture
  • What Technical Skills Can You Expect To Gain From a DevOps Course Syllabus?
  • CI/CD Tools and Technologies: Unlock the Power of DevOps
  1. DZone
  2. Culture and Methodologies
  3. Career Development
  4. What Is a Research Engineer?

What Is a Research Engineer?

And more importantly, does my team need one?

Aleksey Vorona user avatar by
Aleksey Vorona
·
Jul. 01, 19 · Presentation
Like (1)
Save
Tweet
Share
5.35K Views

Join the DZone community and get the full member experience.

Join For Free

research engineer at work

Perhaps you'll find your next solution sooner with the help of a research engineer.

One of the most rewarding aspects of software development is in choosing the right tools. From platforms to programming languages to libraries, this process offers the exciting chance to break loose from the technical debt of past decisions and explore the latest and greatest in emerging technologies.

Of course, pinpointing the right tool can be very challenging. Not only is there a plethora of options, but product owners don't always know the full requirements and constraints of features they're seeking to build.

This struggle typically results in a kind of tooling paralysis, in which software engineers are unhappy with the current tech stack but also worry about the time, effort, and potential headaches of moving to other solutions.

You may also like: 14 Stances of Highly Effective Product Owners

Product owners often gripe about swollen estimates and wonder why it takes multiple sprints to create a feature that could otherwise be completed in a 24-hour hackathon.

This is where a research engineer can make a big impact by methodically evaluating the multiple ways to approach a software problem. As engineers themselves, they're armed with the perspective to find a solution that is both feasible and functional.

From research

A research task starts with a vague idea, usually from a product owner or development manager. This idea is almost always too nebulous to put into a story; in fact, it's common to question whether it's even possible.

For example, the idea may be to "git" an entire application, so that all the configuration changes are captured with rollbacks, branching, and review processes.

In this case, should we store the change history in the database or in a source control repository? Do we write our own UI, or an adapter for a widely-used tool?

This is when the research engineer pokes at the problem from many different angles and investigates whether any such tool exists to solve it. It's my favorite part of the job: exploring the current tooling landscape and navigating the best route to meet the goal.

The first day is usually spent on the Internet and the second in a university library.

For every idea you can think of, there is almost always: a hacker who has tried it out, and an academic who has performed obscure yet insightful research.

To engineering

Now the engineering part of the role kicks in: I take that vague idea, a Haskell proof-of-concept, and an academic paper, and try to write some code. The beginning of this process is straightforward enough, as virtually any modern technology has "Getting Started" guides.

But then I must start thinking about more complex, real-world scenarios. What happens when I add thousands of concurrent users? What if the data is corrupted, or a peer microservice is malicious?

As I continue my investigation, I keep impeccable records. Rather like conducting a scientific experiment, I take note of all steps taken, assumptions made, and results observed.

Now, if I discover a bug, I log it and write a pull request to fix it. This then gives me the unique opportunity to observe the health of that technology's community. For example, was the bug readily accepted, or did I get trolled and name-called for breaking things? How was their code review process? Did they accept my code as a fix? Was there any build automation prior to that?

Asking these questions up front is critical, because my fellow engineers don't have time to waste when they're using this tech to build a new feature.

Once I've completed a proof-of-concept, I present it to engineering team and product owners. This allows for a story to be written and estimated, prioritized in the backlog, and eventually find its way to the product.

To results

One of our process innovations is to involve the research engineer during the implementation phase of the story and join the team for a sprint or two. This is when we discover first-hand whether our original estimates and assumptions were accurate.

We've observed that involving research engineers benefits everyone. Product owners no longer reject vague ideas, rely on third-party expertise ("it works for Google"), or take deep dives into the technology themselves. Instead, they can focus on what they do best: building the features our users want and need.

Engineers benefit from stories that are smaller and more detailed and may even get a working proof-of-concept for a feature they're about to implement. There's constant knowledge sharing between groups, even between offices in different locations. When a 'nomadic' research engineer joins a given team, he or she shares what works for other teams in the company. This promotes more rapid adoption of best practices rather than relying on watercooler interactions.

Conclusion

Tool proliferation remains one of the challenging double-edged swords facing DevOps-minded teams. Dedicating resources to a research engineer can help maximize the adoption of useful applications, minimize risk and complexity, and avoid unnecessary time-and-energy investments down the line.

Further reading

Building Better Teams

About Agile Product Managers, Owners, and Squad Leads

Engineer

Published at DZone with permission of Aleksey Vorona, DZone MVB. See the original article here.

Opinions expressed by DZone contributors are their own.

Related

  • A Brief Guide on How To Become an Efficient Prompt Engineer
  • Building and Sustaining an Open Source Community in the Context of Organizations
  • What Is a Modern Developer?
  • Cracking the Code: Machine Learning Unveils the Secrets of Fault Diagnosis and Root Cause Analysis

Comments

Partner Resources

X

ABOUT US

  • About DZone
  • Send feedback
  • Careers
  • Sitemap

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • Become a Contributor
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 3343 Perimeter Hill Drive
  • Suite 100
  • Nashville, TN 37211
  • support@dzone.com

Let's be friends: