What's Next on IBM i

How bad is your RPG Code

2011-12-04T09:23:00.000-08:00

I've recently participated in a number of discussions that appear on various forums discussing RPG, its future, and value. Frequently these discussions are led by highly skilled professional programmers who utilize the latest features and facilities of RPG and write good structured modular code leveraging procedures, service programs and advanced features of ILE.

I absolutely agree that the most current version of the RPG language has the capabilities of being a superb procedural language and can offer the best structure and results that one could expect from a procedural language.

After thinking about this and looking the realities of most IBM i shops, the simple reality is that most shops do not have programmers of the quality of the folks that write these arguments favoring RPG. In a weird tribute to RPG, it is a language that can be learned, used, and implemented by people with very little training and a virtually no background in computers, technology, or systems.

In fact the vast majority of RPG programmers were blue collar workers without college degrees or training who learned RPG in in-house IBM sponsored training classes, Junior college courses, or 3rd party taught classes.

The vast majority of programmers have never written an RPG program from scratch (i.e. an empty SEU or RDp file) but rather copy and modify existing programs, sample programs obtained from IBM redbooks,or articles in various books, magazines, and publications. Few of these sample programs were examples of good code.

Over the years (and many of you have programs that were originally written 40 to 50 years ago and modified numerous times over the years written by people with all sorts of skills.

Cleaning or replacing this code base is the challenge faced by most IBM i customers. Some vendors including IBM advocate code conversion to EGL (enterprise generation language) or Java. There are many vendors who offer conversion to other language including various Windows technologies.

Straight conversion can cost as much as $1 per line of code resulting in project prices of several million dollars. Conversion projects are extremely risky as the vendor will convert your code from RPG to another language, but they are not responsible for testing or insuring that the new language based system still works and performs well.

Most companies have hundreds of thousands of lines of redundant code, code that is never executed, or should otherwise be cleaned up and improved before any conversion is undertaken.

Some vendors (including IBM) advocate using their conversion tools to convert 5250 green screen applications to web based applications. They argue that you can enhance the web presentation after the conversion.

Vendors like IBM or the many others have superbly skilled programmers and architects. They have no experience with corporate systems built and modified over 40 to 50 years and really have no idea what a company's system portfolio contains. They would be shocked and horrified at that 12,000 line monster that drives one of your critical business applications with the User Interface, business rules, and database access as well as control logic all embedded somewhere in the beast (along with commented out code from previous generations and code that can never be executed).

I recommend use of tools like Databorough's X-Analysis along with a rigorous methodology that mandates restructuring and modernization of each program as current projects require the program to be modified. I also advocate a rigorous program of peer review carefully organized to insure that your very best programmers are reviewing others code.

If you don't want to invest in X-Analysis, then use Hawkeye or at a minimum use DSPPGMREF to an outfile and write some programs to produce reports on the structure of your systems.

Once again, it is only a matter of time until IBM drops support for IBM i and therefore RPG (which only runs on the IBM i operating system). You have time to modernize and replace your RPG based systems but you need to start now. When IBM does drop support for IBM i they will generally support it for 3 years after they announce that the product is discontinued. Even then you can still run your systems and tools as long as you don't need to upgrade your machine or operating system.

The key is to realize that IBM i and RPG will eventually be withdrawn and support discontinued by IBM. They are offering their own tools to convert to Java and modernize now. You need to take the path that makes most sense for you, but you need to move on this.

Will complacency kill IBM i?

2011-12-02T04:45:00.000-08:00

While most westerners rejoiced the recent events of unrest and social reform in the middle east, i am sure many also asked "what took them so long?"

When I tried to answer the question myself about why a large group of intelligent, educated people would accept such leadership, and along with it a stranglehold on their innovation and freedom for so long, i realized that all communities fall into that trap at some stage. Its called complacency.

The IBM i community is no exception.

Think about it for a moment. there has been no real innovation our of IBM i that is directly relevant to the IBM i community since the 80's. in fact there have been some serious misdemeanors on their part. here's a couple: ILE - what's the point of that? if you going to go OO, go OO, don't just poke at it with a long stick! a friend of mine who worked on the RPG compiler team at that time told me that there was a real plan to go the whole way, and truly modernize RPG, but it was vetoed by management. here's another: webfacing - no further comment needed. what about WDSc? basically it destroyed your PC just to get a notepad style code editor up! no wonder people still use SEU. EGL? Great idea, even pretty good implementation for IBM, totally pointless in reality. Scenario: "Hey IBM i have 5 million lines of RPG, and aging work force. i love the platform and IBM. what should i do? answer: Rewrite your entire code base in a language no one uses, using a work force that doesn't exist. huh?

What exactly is a third party vendor? I have asked this question of many people, Mike Smith (ex IBM Chief Architect), Jon Paris, myself, Rich Hume, end users, developers, ISV's, in fact anyone i can ambush into listening to me. The answer it seems is: "not IBM"

So what IP grew the IBM i community to its current size? Firstly of course OS/400 and RPG. But from that moment on: MAPICS, BPICS, JDE, System 21, SYNON, LANSA, PRMS, essentially third party vendors. or rather "not IBM".

There are many in the IBM i community that would skip a system i news mag article about the science of business rules recovery of RPG systems with X-Analysis because it is labeled"Advertorial", in favor of 15 pages of how RDi miraculously helps them edit the one program they write per year these days. Similarly there are some who whinge to Jon Paris about third party vendors lowering the tone of his events and events like his.

the last few publications and events that remain as the conduits to the IBM i community, and who still support the "not IBM" mantra as a given are thankfully giving way to more viral and real communities such as we see on some linked in groups.

I don't think complacency will kill the IBM i community, but hopefully it will kill the bovine leaches who are too lazy to listen to anything but the PR drivel that mostly comes from IBM these days.

RPG Job Trend Stats

2011-11-21T01:53:00.000-08:00

Here are two interesting graphs about the trend of RPG jobs. Whatever the implications are for the future of the IBM i, it certainly does provide little or no incentive for anyone to learn RPG.

rpg Job Trends

Rpg jobs

rpg, java, C#, PHP Job Trends

Rpg jobs - Java jobs - C# jobs - PHP jobs

2011-11-21T01:50:00.000-08:00

Here are two interesting graphs about the trend of IBM i Jobs:

rpg Job Trends

Rpg jobs

How should we be developing applications for the IBM i today?

2011-02-10T13:09:00.000-08:00

This is a response to a discussion started by Gary Lewis on Linked In - http://lnkd.in/EUFmNi

We have been working on this specific subject since 1998. Here’s a little historical and contextual framework:

While we have built RPG based re-engineering tools since 1987, in 1999 we started a project to develop tooling to completely re-engineer an RPG application into an event driven MVC model with a web/gui front end. Oddly enough this was inspired after we wrote a tool to put RPG into SYNON at the request of IBM way back then. The objective of the new project was not to just to technically achieve a modern GUI on as/400 based system, but to produce reworked code that was more maintainable than previously, and also adopted the most mainstream technologies for development and deployment.

It has been a long road that includes writing an IBM Redbook on the subject (click here) and various technology/development partnerships including Rational, Oracle, Microsoft, MyEclipseBlue, Fiserv, Mapics, SSA Global, and various other end user companies. We have built technologies for generating View Controller layers in Java Servlets and generated HTML, RCP on Eclipse. Java Swing fat client, JSON/Web2.0 dynamic web client, EGL JSP's, JSP and JSF using Spring/Hibernate, ASP, Silverlight, Flex, and more recently RPGLE. We have tried and tested almost all tactical technologies such as wefacing, emulation, special files, Dynamic Screen Mangement API’s, even CGi as part of the R&D effort. Also know we have assessed these approaches on many of the largest existing as/400 apps on the world, a good number of which are our customers.

Now let me share our findings and evolved best practices by answering your points more directly. These results are not just about technology fads or personal preferences, but the accumulation of literally 12 years of R&D specially on this subject, just so we can build sellable tools reengineer effectively into this new environment. I won’t elaborate on why with all points, but just to give you an example of lessons learned: What we discovered was that when building increasingly sophisticated UI’s as technologies and user requirements advanced, a critical mass was soon reached where the code used to render server generated screens became too complicated to maintain productively. Turn it on it’s head and build the view and Controller in a modern language(using event driven languages tightly integrated with screen actions like VB), and ongoing maintenance and development was much simpler and could be deskilled significantly for typical business apps. The reason target IDE & Technology was a big part of the R&D is that what made the as/400 big in the first place: The development ecosystem productivity PLUS the reliability, scalability etc. So any company that would potentially buy our re-engineering tooling would have that expectation built into the requirement.

Gary's questions included:

How would the application architecture look like?

Model View Controller – VC in any modern UI language, Model in RPGLE-Free, and DB2/i for all the good stuff

Should we just use the IBM i as a database?
no. Business logic/Model layer too

Should business rules be in the DB, stored procedures or application logic?
Application Logic – this can be implemented and used as stored procedures simultaneously. Implementing in the DB works for pure constraints, but the dev tooling and process is slowed down by over engineering where you put business logic

Where should the application logic reside?
User driven and system, Navigational logic in the Controller, Conditional navigation logic in the Model – This should not always be strictly adhered to in all instances.

What language and IDE would you use?
VC : VS2010, MyEclipseBlue, and the one that has impressed us the most in 12 years: Oracle ADF
Model: RDp

DB design - Should we use surrogate keys?
Only on new databases where possible.

RPG Free or Fixed? OR Modernize your code base

2010-03-26T20:34:00.000-07:00

As most of you who read this blog know I am no fan of RPG. I in fact urge you to create plans to move away from RPG as fast as is feasible for your business. I also recognize that this cannot be done overnight and that any realistic plan is really a 7 to 10 year plan.

I'm writing this blog tonight after a long hiatus after reading a somewhat disturbing discussion on one of the Linkedin forums about whether or not folks should using free form RPG.

While the creators and contributors were well intentioned, they are really missing the key point. Namely the need to restructure, and modernize their existing application systems into modular ILE base reusable modular code.

I would personally take a close look at Databorough LTD's X-Analysis and related suite of products as a first step in discovery, analysis, simplification, and modernization. I would then look at tools to refactor code into modular resuable components that can be leverage in web services and other modern technologies. This initiative which can be highly automated can greatly reduce the cost, complexity, and risk of moving away from RPG and eliminating your dependency on IBM i.

It can also enable you to leverage your existing systems and modern service based applications and provide significant value to your organization.

The Internet is Running out of IP Addresses

2009-12-16T11:17:00.000-08:00

According to the folks at http://bit.ly/6QK89F we will run out of IP4 Internet addresses on Oct 25, 2012.

This is so typical of the IT industry. Back in 1995 when the Internet was opened for commercial use work was well underway to support IPV6 and most hardware and software companies including IBM with the iSeries have had support for IPV6 for years. This is pristine software as virtually NO ONE has ever used it!

Oh well, the world needs a new crisis! Maybe Al Gore who as you will recall invented the Internet will step up to the plate and fix this! Oh yes, of course those other companies will change their addressing schemes to IPV6 and we will still be able to use IPV4!

Right!

Well folks this one will be interesting!

Databorough Announces X-Analysis Lite

2009-12-03T11:51:00.000-08:00

X-Analysis Lite offers the industry’s most powerful cross referencing at budget prices

Toronto, Canada -- Thursday, 03 December 2009, -- Databorough, a leading vendor of tools for IBM i, today announced a cut-down version of X-Analysis its flagship product, the recognized world leader in analysis, documentation, design recovery and reengineering tools for system i.

X-Analysis Lite is Databorough’s response to the demand from the broad community of smaller IBM i shops that love the X-Analysis functionality, but don’t have budgets that stretch to the enterprise versions of the product. Along with a set of proven and powerful analysis features, the Lite package includes three of the most popular and productive features from the enterprise versions of X-Analysis. They are: Application Mapping, Variable Tracing Technology, and Interactive Graphical Diagramming, and provide critical functionality to thousands of RPG and COBOL developers using X-Analysis 8 on IBM i worldwide. X-Analysis Lite also comes with bi-directional interfaces to IBM’s WDSc and RDi products, as well as stand-alone versions for traditional SEU users. An introduction discount for upgrades from Hawkeye is available.

IBM is now hosting a configuration of the Lite on the IBM Enterprise Modernization Sandbox for i, see:

IBM Enterprise Modernization for System i: Discover and understand RPG applications with X-Analysis

Application Mapping builds a complete map of an entire application and stores it in a readable DB2/400 database library. All objects are cross referenced first, and then every single source member of any type is parsed and mapped down to individual variables and how they relate to other variables, not just fields. A number of X-Analysis users, ISV’s, and partners have already developed their own add-ons and services using the Application Map Repository.

Variable Tracing Technology uses the Application Map to programmatically trace variables and fields across and entire system. This means that impact analysis for changes can be done for multiple levels, or variants of a field or variable, in a single inquiry. This unique to X-Analysis feature, has saved many companies thousands of man hours in analysis time. See our Case Studies for details. It is also one of the key features that prompts users of legacy tools such as Hawkeye to upgrade.

Interactive Graphical Diagramming is the most commonly used and popular feature of the X-Analysis suite. Developers, analysts and support teams can see structure and process in interactive, graphical color-coded diagrams. Drill down capability into color coded source browsing and navigation through diagrams across the entire application. “GPS for Legacy Applications!” as one user described it.

Running over RPGII/III/IV/Free, CL and COBOL on IBM i X-Analysis Lite is available direct from Databorough or through our extensive partner network.

Additional information is available on the Web at http://www.databorough.com/lite

About Databorough

Databorough Ltd. is a leading vendor of innovative software tools enhancing IBM i legacy applications and taking them into a 21^st century environment.

Databorough’s software is developed and maintained by development teams in Canada, UK, France and India. It is at work, worldwide, in companies including market leaders in the manufacturing, distribution, retail, services and financial and application software sectors.

Databorough is headquartered in Weybridge, near London, United Kingdom. The company’s main North American office is in Toronto, Canada and its main R&D centre is in Lucknow, India.

###

All product and company names may be trademarks or registered trademarks of their respective holders.

CONTACTS:

Databorough:
Stuart Milligan, Tel: (917) 267-7523
email: stuartm@databorough.com

How much RPG application code is still relevant & unique

2009-09-05T05:49:00.000-07:00

This is the most important question that many CIO's who have as/400 applications are asking themselves. Why are they asking this?

Cost and risk. It costs a lot more money to write your own applications in house than it does generally to buy one off the shelf. The reason being that you have to hire people to write and maintain the code. That's where the risk comes in. If i lose the person who wrote the code then i also potentially impact my ability to enhance and support that same code at the same costs and quality.

Since the introduction of the as/400 in 1988 a lot of custom code has been written on the platform in RPG. The fact that the majority of this code is still around and in use, is testament toRPG itself which makes it possible for analysts with business knowledge, to write a large portion of the code.

In helping customers worldwide to analyse and re-engineer their RPG applications over the last 25 years Databorough has accrued a fairly unique knowledge of the size and characteristics of the this code base in general. we estimate that there is at least one billion lines of custom code in existence on as/400's worldwide.

Before any CIO can make an informed decision on what application strategy to adopt: rewrite, modernize, replace, exactly how much of this code is still relevant and unique to the business must be known. This is in terms of business rules, data model design and flow/process logic. Extracting this information quantitatively, narrating it and documenting it on a million lines ofRPG code that has been written over 20 years, would take 5 people who would need excellentRPG and analysis skills, at least one year working full time.

That's at least half a million dollars direct cost. That is of course if there were enough such people available to do this work over and above ongoing support and maintenance demands on these same applications.

Over the last decade Databorough has been enhancing X-Analysis to the point where it can now automatically extract, narrate and document business rules, data models and process/flow logic for entire systems. Some of the systems X-Analysis runs over currently have in excess of 50 million lines of code, some as little as half a million. The difference in extraction time is usually a couple of hours.

The added benefit is that these extracted specifications can then be used to map to off-the shelf apps, as input specs for rewriting the unique and relevant parts, and even to automatically re-engineer the existing code where necessary.

This might make it clearer as to why IBM promote and use X-Analysis themselves in conjunction with their own tools, a few links to this are detailed below. There are also a few of our partners and independent agents who are offering modernization assessment services which help start this process. Some of these include, Sirius, ADC-AustinTech, IBM Global Services, and Oxford International.

So CIO's don't need to guess or accept others guesswork. They can make these critical decisions on provable, current, accurate and quantifiable information.

Here are a couple of useful links:

X-Analysis Design Recovery

IBM Redbook on X-Analysis

IBM Modernisation Strategy

Modernization Concepts Guide

Stuart

How much RPG code is Relevant?

2009-09-04T07:22:00.000-07:00

Stuart started an excellent post on the value of a company's inventory of RPG. In my life before I went to work for IBM, I was CTO for a major insurance company who developed most of their systems in-house. We had a legacy of RPG code dating back over 40 years beginning with an IBM System III and RPG-II.

While we had some excellent RPG programmers over the years we also had many that were not so excellent and wrote code that worked but was quite frankly not very maintainable. This code would read like an English language conversation, had incredible amounts of redundant IO -- yes the same record read each time an edit, validation, or field was changed on a single screen.

The screen handling IO was embedded with business logic to the point that it was virtually impossible to segregate business logic form 5250 IO from Database access. In other words, spaghetti code.

As a company moves toward modern UI's and services like Web 2.0 and Web Services, it would be incredibly desirable to leverage existing business logic in existing RPG code. Extracting viable bits of code into reusable components can be a daunting task making a total rewrite of the application a better choice for many CIO's.

Databorough's X-Analysis offers some hope and tools to facilitate harvesting of business rules into reusable components (ILE modules, procedures, or at least subroutines). It also provides via its English Language psuedo code a way to facilitate a straight rewrite of code if that's the route you choose in the same or different language.

BTW, don't blame the programmers totally for the code you are stuck with. Much of the code you see in your shop are based on IBM examples from REDBOOKS or other "experts" BOOKS leveraging changing positions on performance over the years.

At one time you wanted your code totally sequential and in-line with no subroutines to optimize how the CPU would process your code.

Some of you may be stuck with code generated by 4GL's that is virtually unreadable. Quite often the code was generated using a 4GL vendors tools and your programmers then had to manually modify the code to add functionality that the 4GL did not provide. Once this was done you had code that could no longer be maintained by the 4GL tools. These programs have hundreds of lines of redundant unnecessary code.

The best solution are tools that can analyze and help you identify what is relevant and what is not.

What about RPG II code? I know that in my previous life a huge number of my RPG Programs were written in RPG II. Depending on your business requirements it may be worthwhile to first move your old RPG II or OPM RPG III code to ILE before doing anything else.

If you still have programmers writting in the old RPG II style you have some major skills problems to deal with as well as the code.

Databorough's tools are not a silver bullet, but they can definitely help you understand what you have and form a modernization strategy based on facts and provide CIO's with a means of managing a modernization project in an objective manner that minimizes risk.

X-Analysis 8 produce System Documents as PDF

2009-08-24T05:58:00.000-07:00

PDF format is the defacto standard when it comes to sharing the documents. X-Analysis 8 can now produce System documentation as PDF.