DZone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Over 2 million developers have joined DZone.
Log In / Join
Please enter at least three characters to search
Refcards Trend Reports
Events Video Library
Refcards
Trend Reports

Events

View Events Video Library

Zones

Culture and Methodologies Agile Career Development Methodologies Team Management
Data Engineering AI/ML Big Data Data Databases IoT
Software Design and Architecture Cloud Architecture Containers Integration Microservices Performance Security
Coding Frameworks Java JavaScript Languages Tools
Testing, Deployment, and Maintenance Deployment DevOps and CI/CD Maintenance Monitoring and Observability Testing, Tools, and Frameworks
Culture and Methodologies
Agile Career Development Methodologies Team Management
Data Engineering
AI/ML Big Data Data Databases IoT
Software Design and Architecture
Cloud Architecture Containers Integration Microservices Performance Security
Coding
Frameworks Java JavaScript Languages Tools
Testing, Deployment, and Maintenance
Deployment DevOps and CI/CD Maintenance Monitoring and Observability Testing, Tools, and Frameworks

The software you build is only as secure as the code that powers it. Learn how malicious code creeps into your software supply chain.

Apache Cassandra combines the benefits of major NoSQL databases to support data management needs not covered by traditional RDBMS vendors.

Generative AI has transformed nearly every industry. How can you leverage GenAI to improve your productivity and efficiency?

Modernize your data layer. Learn how to design cloud-native database architectures to meet the evolving demands of AI and GenAI workloads.

Related

  • Integrating Model Context Protocol (MCP) With Microsoft Copilot Studio AI Agents
  • A Developer's Guide to Mastering Agentic AI: From Theory to Practice
  • Reinforcement Learning for AI Agent Development: Implementing Multi-Agent Systems
  • Why Clean Data Is the Foundation of Successful AI Systems

Trending

  • Navigating and Modernizing Legacy Codebases: A Developer's Guide to AI-Assisted Code Understanding
  • Introducing Graph Concepts in Java With Eclipse JNoSQL
  • Enhancing Business Decision-Making Through Advanced Data Visualization Techniques
  • Advancing Your Software Engineering Career in 2025
  1. DZone
  2. Data Engineering
  3. AI/ML
  4. The Pitfalls of Using General AI in Software Development: A Case for a Human-Centric Approach

The Pitfalls of Using General AI in Software Development: A Case for a Human-Centric Approach

Beneath the alluring surface lies a significant challenge: the difficulty of modifying General AI-based systems once they are deployed.

By 
Dursun Koç user avatar
Dursun Koç
DZone Core CORE ·
Oct. 01, 23 · Opinion
Likes (4)
Comment
Save
Tweet
Share
36.4K Views

Join the DZone community and get the full member experience.

Join For Free

With the development of general artificial intelligence, it is now also taking its place in jobs that require intellectual knowledge and creativity. In the realm of software development, the idea of harnessing General AI's cognitive capabilities has gained considerable attention. The notion of software that can think, learn, and adapt like a human programmer sounds enticing, promising to streamline development processes and potentially revolutionize the industry. However, beneath the surface allure lies a significant challenge: the difficulty of modifying General AI-based systems once they are deployed.

General AI, also known as Artificial General Intelligence (AGI), embodies the concept of machines possessing human-like intelligence and adaptability. In the world of software development, it has the potential to automate a myriad of tasks, from coding to debugging. Nevertheless, as we delve into the promises and perils of incorporating General AI into the software development process, a series of critical concerns and challenges come to the forefront.

  1. Lack of Transparency: Its lack of transparency is at the heart of the problem with General AI in software development. Understanding how the AI arrives at decisions or solutions can be perplexing, rendering debugging, troubleshooting, or modifying its behavior a formidable task. Transparency is a cornerstone of code quality and system reliability, and the opacity of General AI presents a substantial hurdle.
  2. Rigidity in Behavior: General AI systems tend to exhibit rigidity in their behavior. They are trained on specific datasets and instructions, making them less amenable to changes in project requirements or evolving user needs. This inflexibility can lead to resistance when developers attempt to modify the AI's behavior, ultimately resulting in frustration and reduced efficiency.
  3. Over-Automation: While automation undeniably enhances software development, overreliance on General AI can lead to excessive automation. Automated systems, although consistent with their training data, may not always align with the developer's intentions. This overdependence can curtail the developer's creative problem-solving capacity and adaptability to unique project challenges.
  4. Limited Collaboration: Software development is inherently collaborative, involving multiple stakeholders such as developers, designers, and project managers. General AI systems lack the capacity for meaningful collaboration and communication, hindering the synergy achievable with human teams. This can lead to misaligned project goals and communication breakdowns.
  5. Ethical Concerns: The use of General AI in software development raises profound ethical concerns. These systems may inadvertently perpetuate biases present in their training data, resulting in biased or discriminatory software. Addressing these ethical issues is intricate and time-consuming, potentially diverting resources from development efforts.

In light of these challenges and pitfalls, a human-centric approach to software development retains its essential significance. AI should be viewed as a tool that enhances and supports developers rather than replacing them entirely. Here's why this human-centric approach remains indispensable:

  1. Transparency and Control: Human developers possess the capacity to understand, control, and modify the code they create. This transparency empowers them to swiftly address issues, ensuring that software aligns with user requirements.
  2. Adaptability: Human developers can respond effectively to shifting project requirements and unexpected challenges. They can pivot, iterate, and employ creative problem-solving approaches, a flexibility that General AI may struggle to replicate due to its rigid training.
  3. Collaboration: Collaboration and communication are cornerstones of software development. Human teams can brainstorm, share ideas, and make collective decisions, fostering innovation and efficiency in ways that General AI struggles to emulate.
  4. Ethical Considerations: Human developers actively work to mitigate bias and ethical concerns in software. They can implement safeguards and engage in responsible AI practices to ensure fairness and equity in the software they create.

In conclusion, while General AI holds great potential across various industries, including software development, its pitfalls and limitations must not be overlooked. Developers may encounter substantial challenges when attempting to modify General AI-based systems post-deployment, including issues related to transparency, rigid behavior, and ethical considerations. A human-centric approach that highlights the indispensable role of developers in creating, controlling, and adapting software remains paramount in addressing these challenges and delivering high-quality software products. As technology continues to evolve, striking a balance between automation and human creativity in the software development process remains a critical goal.

AI Artificial general intelligence Software development process systems

Published at DZone with permission of Dursun Koç, DZone MVB. See the original article here.

Opinions expressed by DZone contributors are their own.

Related

  • Integrating Model Context Protocol (MCP) With Microsoft Copilot Studio AI Agents
  • A Developer's Guide to Mastering Agentic AI: From Theory to Practice
  • Reinforcement Learning for AI Agent Development: Implementing Multi-Agent Systems
  • Why Clean Data Is the Foundation of Successful AI Systems

Partner Resources

×

Comments
Oops! Something Went Wrong

The likes didn't load as expected. Please refresh the page and try again.

ABOUT US

  • About DZone
  • Support and feedback
  • Community research
  • Sitemap

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • Become a Contributor
  • Core Program
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 3343 Perimeter Hill Drive
  • Suite 100
  • Nashville, TN 37211
  • support@dzone.com

Let's be friends:

Likes
There are no likes...yet! 👀
Be the first to like this post!
It looks like you're not logged in.
Sign in to see who liked this post!