TrustRadius: an HG Insights company

IBM Bob FAQ Detail

Score9 out of 10

183 Reviews and Ratings

Back to FAQ

How reliable and accurate is AI-generated code?

21 citations from LLM engines

According to TrustRadius reviews, the reliability and accuracy of AI-generated code from IBM Bob have both strengths and weaknesses. Reviewers report that it can deliver very good and valid code in languages like Python, Cobol, Java, and SQL. It is also praised for its ability to modernize legacy code with minimal errors and for its understanding of the IBM stack. However, some reviewers caution that the tool can generate incomplete code, miss certain dependencies, or hallucinate details about internal database fields. To improve reliability, reviewers note that the product allows users to scan code for vulnerabilities before shipping to production.

Prompt Questions

  • which ai code generation platforms have the strongest track record for uptime and reliability at enterprise scale?

  • as a developer at an insurance company, how much can i trust ai-generated code for calculations involving actuarial models?

  • as a developer at an engineering consultancy, how do i know which ai-generated code snippets are safe to hand off in a client deliverable?

  • are ai code generation tools actually reliable enough to use in real software projects, or do they need heavy human review?

Generates Quality Code in Specific Languages

3 mentions

Reviewers state that IBM Bob produces good and valid code for languages including Python, Cobol, Java, and SQL. It is a…

Reviewers state that IBM Bob produces good and valid code for languages including Python, Cobol, Java, and SQL. It is also used to modernize legacy RPG code with minimal coding errors.

“Bei Python, Cobol und Java liefert er sehr gute Code”
Principal Consultant at PROFI AG, PROFI AG (medium)View Full review
“IBM Bob delivers very good code in Python, Cobol, and Java”
Principal Consultant at PROFI AG, PROFI AG (medium)View Full review
“Bob can generate valid SQL and Utility statements based on my requests.”
Professional in Engineering (large)View Full review
“Currently we use IBM for a modernization and easing workload on developers. Enabling us to create more modern version of legacy RPG code with ease and minimal hassle and coding errors.”
Engineer in Information Technology (large)View Full review

Instances of Inaccurate or Incomplete Code

4 mentions

Some reviewers have experienced issues with the accuracy of the generated code. They report that it can be incomplete,…

Some reviewers have experienced issues with the accuracy of the generated code. They report that it can be incomplete, fail to account for dependencies and restrictions, or hallucinate when asked about internal database fields. One user expressed that the tool should always provide syntactically correct code.

“In some cases, it generates incomplete code”
Employee in Information Technology (large)View Full review
“IBM Bob should always give me syntax correct code”
System admin at Handelsbanken, Handelsbanken (large)View Full review
“While he can code accurate statements, if I ask him to create a tool that enforces syntax, some restrictions and dependencies are not accounted for.”
Professional in Engineering (large)View Full review
“Using actual data from IBM i documentation, I asked it for help creating some new coffee that rely on knowing internal db fields and it allucinate”
Consultant in Engineering (small)View Full review

Code Scanning and Security Features

2 mentions

IBM Bob offers features to enhance code reliability, such as the ability to inspect the entire code base and scan for C…

IBM Bob offers features to enhance code reliability, such as the ability to inspect the entire code base and scan for CVEs before deployment to production.

“You can scan your code to check for CVEs before you ship to production.”
Engineer in Information Technology (small)View Full review
“IBM Bob inspects the whole code base”
Consultant in Finance and Accounting (small)View Full review

Strong Understanding of the IBM Stack

1 mention

A key strength noted by a reviewer is that IBM Bob understands the IBM stack, which allows it to help with generating a…

A key strength noted by a reviewer is that IBM Bob understands the IBM stack, which allows it to help with generating and optimizing code within that environment.

“It really understands the IBM stack and can help with generating and optimizing the code.”
Team Lead in Engineering (large)View Full review

Perceived Safety Compared to Other AI

1 mention

One reviewer feels that the way IBM Bob operates is quite safe in comparison to other AI tools.

One reviewer feels that the way IBM Bob operates is quite safe in comparison to other AI tools.

“I feel that the way it works is quite safe compared to other AIs”
Engineer in Engineering (medium)View Full review

Showing top 5 topics · 12 total quotes across all topics

No quotes available.