Integration solutionsWhite paperIBM WebSphere TransformationExtender, Version 8.1Helping you transform, validate and route vital business informationbetween applications, across and beyond your organizationSeptember 2006
IBM WebSphere Transformation Extender, Version 8.1Page Contents2Introduction2Track record3Value proposition3Service oriented architecture4Web services4Mainframe scalability5Flexible deployment5Time to value6WebSphere TransformationExtender overview8Design tools11 Monitor and manage12 New in Version 8.112 Globalization15 Packaged offerings tailored to yourintegration needs19 Summary19 For more informationIntroductionIBM WebSphere Transformation Extender is a universal transformationengine ready to be deployed stand-alone, embedded within applications, inmost IT infrastructures. It can play a pivotal role in helping IBM clientstransform, validate and route vital business across internal business systems, aswell as their extended value chain of trading partners. You can make the mostof WebSphere Transformation Extender by using it to automate the exchangeof high volumes of large business documents containing sophisticatedstructured content, which you can manage without having to write additionalcode. You can also gain significant benefit when you use automatic, in-flight,data validation to help ensure industry-standard and regulatory compliance.The product’s universality makes it equally at home as a standalone solution orwhen adding value to IBM WebSphere infrastructures — enabling you to reuseskills and assets necessary to address changing business requirements anddevelop new business solutions.This white paper discusses the WebSphere Transformation Extender productfamily, illustrating the breadth and depth of its capabilities as a universaltransformation engine for the WebSphere platform. The target audience forthis paper is anyone considering introducing new transformation services orwanting to upgrade their existing transformation capability with acomprehensive, universal solution.Track recordWebSphere Transformation Extender is the result of IBM’s recent rebrandingand continued development of the IBM WebSphere DataStage TXtransformation engine and industry accelerators IBM acquired with thepurchase of Ascential Software Corporation. Also, Ascential had gained accessto core technology from its acquisition of Mercator Software. WebSphereTransformation Extender is a mature technology that includes support for theIBM System z platform, and complements the IBM WebSphere productportfolio. The product has an extensive customer base in healthcare, as well asin financial services and insurance.
IBM WebSphere Transformation Extender, Version 8.1Page Value propositionWebSphere Transformation Extender is designed to meet the needs ofinformation- and application-integration architects and developers whoneed to integrate diverse and complex data across your enterprise. IBM offerscomprehensive support for using industry-standard electronic documentswith commonly used transformations ready to use. Designed with electronicdata interchange (EDI) users in mind, WebSphere Transformation Extendercan process large documents of virtually any size and complexity.WebSphere Transformation Extender has GUI-based design tools that enableyou to quickly design data structures, validation rules and managetransformation and routing requirements, without the need for programmingskills. You can use these design tools to handle almost any electronic documentcontent of practically any sophistication. For integrating applications andinformation stores with custom adapters, or for calling the transformationengine when embedded inside an application or application server,programming interfaces are available as a developer kit.Service oriented architectureChoosing WebSphere Transformation Extender gives you a simple entrypoint to service oriented architecture (SOA), without having to worry aboutdisrupting your business. The IBM WebSphere SOA approach recommends atop-down, enterprise vision and architecture to help ensure consistency, whileenabling a bottom-up implementation, project by project, service by service.No matter where you are in the SOA life cycle, WebSphere TransformationExtender performs a key role, whether you are just starting out with a smallproject, or you have already implemented your SOA.
IBM WebSphere Transformation Extender, Version 8.1Page Web servicesWebSphere Transformation Extender provides integration solutions thataccelerate the adoption of Web services, helping to eliminate the timeconsuming and risky overhaul of critical business systems. By providingsupport for importing Web Services Description Language (WSDL), throughthe WSDL importer, and sending and receiving SOAP messages (using SOAPand HTTP adapters), WebSphere Transformation Extender products enablesolutions for both consumers and providers of Web services.Mainframe scalabilityMainframes continue to play a key role in many enterprises for several reasons.In some cases, the volume of data, such as very large databases, is simply toolarge to be moved off the mainframe. In other cases, an upgrade path isn’tavailable, such as with IBM IMS software. Also, mainframes can simply bethe most reliable platform upon which to run corporate data for day-to-daybusiness functions. Many enterprises have made strategic commitments todeploy data-integration applications on mainframes. These enterprises wantto continue to take advantage of the scale, security and expertise they haveon the mainframe.WebSphere Transformation Extender usage includes IBM AIX , Microsoft Windows , and Linux platforms, Red Hat and SUSE Linux, Sun SolarisOperating Environment and HP-UX. But more significantly, WebSphereTransformation is being used in COBOL applications, in triggering batchapplications, as well as in integrating IBM CICS applications and IMSapplications and UNIX System Services (USS) on the IBM z/OS platform.
IBM WebSphere Transformation Extender, Version 8.1Page Flexible deploymentYou can deploy WebSphere Transformation Extender in several ways: As a stand-alone server, connecting to applications with technology adapters. As a hosted component in a Java 2 Platform, Enterprise Edition (J2EE)application server. Embedded inside your custom C, Java, and COBOL applications usingthe application programming interfaces (APIs) provided in a softwaredevelopment kit (SDK). Integrated with IBM enterprise service bus (ESB) offerings, extending theirexisting transformation capability. These can be loosely coupled with a technologyadapter or can be tightly coupled, as in the case of IBM WebSphere TransformationExtender for Message Broker.Time to valueYour integration developers and architects can use IBM WebSphereTransformation Extender Design Studio to visualize simple and complexdata types, mapping between them using the robust data-processing andmanipulation capabilities provided — a coding-free activity. A comprehensivelibrary of prebuilt functions is included to help reduce development time witheasy-to-use rules specifications for validation, transformation and routing.You need the APIs in the SDK only when adding transformation capabilitydirectly into applications or writing custom adapters.You can also help accelerate time to value with optional WebSphereTransformation Extender industry and application packs. Each pack providessolutions to integrate industry-wide common data formats across yourenterprise infrastructure, including predefined metadata and importers formajor industry applications and standards, such as X12 EDI, HIPAA, HL7 andSWIFT. As standards change, IBM provides timely upgrades to the solutionpacks, helping to protect your investment and help ensure that your businesscan quickly assimilate industry-led requirements.
IBM WebSphere Transformation Extender, Version 8.1Page WebSphere Transformation Extender overviewFigure 1 summarizes the constituent components of the WebSphereTransformation Server family. This section describes in more detail therole these components play. Some have been mentioned in passing in theprevious bjects)WebSphereTransformationExtender Design StudioPlatform APICommand Server, Launcher or embedded environmentAdapter framework and resource ndercore engineWebSphereTrading ManagerTransformationExtenderTrading ManagerExecution andresourceenvironmentIndustry andapplicationapplicationacceleratorsPACKsFigure 1. WebSphere Transformation Extender component overviewCore engineThe core work-execution (transformation) engine performs the tasks ofparsing inbound data and applying functions to validate and manipulate fieldsto generate the outbound data. Programming and platform interfacesenable applications or operating-system scripts to call the transformationengine directly.Execution and resource environmentThese components extend the core engine with more implementationcapabilities. The industry and application packs provide time-to-valueaccelerators for integration solutions. Industry-standards adoptionhelps mitigate transformation challenges by exchanging common documentswithin a trading-partner community that adheres to a standard exchangeformat and protocol. Application packs accelerate the integration ofcritical applications, such as SAP, Siebel and PeopleSoft. The framework foradapters manages the interface between the transformation engine and theadapters used to connect applications, while the resource manager resolveslogical name aliases of directory paths or file names to actual names at runtime. This makes it possible to use the same maps and systems definitions indifferent systems.
IBM WebSphere Transformation Extender, Version 8.1Page Command serverCommand server components let you control how a transformation isimplemented by calling the transformation engine directly from a commandline, shell script or timer. These components enable you to integrate batchapplications or infrastructure with minimal intrusion.LauncherA launcher is an online runtime environment that synchronizes and controlscomplex data transformations. The launcher activates transformations basedon triggers, which can be a file creation, a message arriving on an IBMWebSphere MQ queue, a database trigger, a timer and many other options,including combinations of triggers. A launch event agent is also available as anoption, adding an inbound HTTP agent to listen and respond to HTTP requests.Trading managerTrading manager includes two components: partner manager (a graphicalclient for administering partner and trade-link information) and messagemanager (a runtime system that manages integration of inbound andoutbound partner messages). Users can audit, control, monitor and view anentire business-to-business (B2B) integration environment across theextended enterprise.
IBM WebSphere Transformation Extender, Version 8.1Page Design toolsDesign tools are provided as a GUI-based integrated development environment(IDE) in which you can develop, import, test and performance-tunetransformations and metadata. Then, you can deploy them to the workexecution engine for system test and production implementation. The keyproductivity tools for designers are described below.Type designer is the data-object modeling component used to create andmanage type trees that define properties for data structures, definecontainment of data, create data validation rules and more (see Figure 2). Itincludes importers for automatically generating type trees (data-objectdefinitions) for data that is described in formats such as XML and COBOLCopybooks, and structures specific to applications like SAP R/3, BEA Tuxedo,TIBCO Rendezvous and PeopleSoft EnterpriseOne.Figure 2. Type designer
IBM WebSphere Transformation Extender, Version 8.1Page Map designer is the modeling component used to formulate transformation andbusiness rules (see Figure 3). It uses data-object definitions created in the typedesigner as inputs and outputs. The map designer provides functionality thatenables you to specify rules for transforming and routing data, as well as theenvironment for analyzing, compiling and testing the maps that are developed.Figure 3. Map designerDatabase interface designer is the modeling component used to importmetadata about queries, tables and stored procedures for data stored inrelational databases. The database interface designer identifies characteristics,such as update keys and database triggers, of those objects to meet mappingand implementation requirements.
IBM WebSphere Transformation Extender, Version 8.1Page 10The integration flow designer is used to define interactions among maps andsystems of maps, to validate the logical consistency of workflows and to preparesystems of maps to run (see Figure 4).Figure 4. Integration flow designerType-tree maker is a scripting tool that automates the capture of metadatafrom machine-processable sources to create graphical metadata in the formof type trees.Command server is the server component that enables command-drivenimplementation. The Windows version is included as part of WebSphereTransformation Extender Design Studio for testing maps within the mapdesigner development environment.Resource registry is an application that provides a resource alias repository,used to abstract parameter settings using aliases that resolve at run time tospecific resources within the enterprise. These variables are automaticallyresolved to the actual resources (such as directory paths, database names,message queues and server names) at run time, making it possible to use thesame map and system definitions in different environments.
IBM WebSphere Transformation Extender, Version 8.1Page 11Command-line alternativesCommand-line utility commands also automate many deployment-relatedactivities of design studio tools applications, including type-tree analysis,importing and exporting type trees, map compilation, and importing andexporting map-source files and system deployment. These utilities offer thebasic functions to run from the command line or within a command script.Manage artifactsThe design tools provide a direct interface to any source-control package thatsupports the Source Code Control Interface (SCCI) API. This capability givesyou a choice of source-control package (such as IBM Rational ClearCase ,Microsoft Visual SourceSafe or Merant PVCS) that you can use to control theversions of the transformation artifacts.Monitor and manageThe management and monitoring tools are graphical applications that enableyou to view, stop and start transaction instances running in the event serverruntime environment provided in the WebSphere Transformation Extenderwith Launcher edition. Refer to “Packaged offerings tailored to yourintegration needs” on page 13 for a summary of packaging options. Thesegraphical tools, shown in Table 1, run on Windows and UNIX and can be usedwith remote and local hosted launchers.Launcher administration GUI is the administrative interface to the event server,from which you can specify deployment directories, configure users and useraccess rights, specify listening ports and define properties for Java RemoteMethod Invocation (RMI).Management console is the management and monitoring interface for theevent server, from which you can start, stop, pause and resume the system, aswell as view information about the status of the event server and maps that arebeing run.Event server monitor is a Windows GUI showing a dynamic, detailed view ofwatches (single map instances) as they run, as well as providing the capabilityto create snapshots of detailed watch activity.Snapshot viewer is a Windows GUI that you can use to display snapshots takenin the event server monitor that show details about event server activity at aspecific moment in time.Table 1. Management and monitoring
IBM WebSphere Transformation Extender, Version 8.1Page 12New in Version 8.1WebSphere Transformation Extender is a powerful enhancement to manynative transformation capabilities included in other WebSphere productsand in stand-alone or programming environments. IBM WebSphereTransformation Extender, Version 8.1 introduces the following enhancements: Enhanced code-page support that helps expand globalization A new map profiler spanning run maps that helps improve performance Consumability improvements, such as a new remote debugger, an enhanced GUIand easier accessibility New mapping and dynamic functions that help increase the power and flexibility ofyour transformationsGlobalizationEnhanced code-page support means that WebSphere Transformation Extendernow has more than 200 code pages and multiple locales. WebSphereTransformation Extender, Version 8.1 can automatically convert between codepages and validate output fields, such as date and time, based on object locale.Collation, searching and comparisons are also performed automatically basedon locale. Any character from any code-page can now be entered directly intothe WebSphere Transformation Extender Design Studio.
IBM WebSphere Transformation Extender, Version 8.1Page 13PerformanceAn extended performance profiler utility records time and implementationsthat span run maps. As a result, you can now get a clear picture of theperformance characteristics of your entire transformation process at a glance.You no longer have to split a complex map into a series of stand-alone maps orignore run maps in your analysis. The entire transformation performanceprofile is displayed in a single report that you can view as a text file or importinto another program, such as a spreadsheet, for analysis.ConsumabilityThe current visual debugger built into WebSphere Transformation ExtenderDesign Studio has been extended to debug remote transformations. Fromwithin WebSphere Transformation Extender Design Studio, you can debug atransformation running on a remote Windows, UNIX, Linux, or z/OS USScomputer. You do not need to duplicate the entire runtime environment on yourdevelopment machine to take advantage of the remote-debugger capabilitiesincluding breakpoints, data inspection, step-in-out-over and more. Also, theuser interface includes more than 30 individual enhancements specificallydesigned to make the development and testing environment faster and easier touse. The design remains consistent with previous versions. Accessibility hasbeen enhanced. Almost the entire user interface in WebSphere TransformationExtender is now compliant with the U.S. Government Section 508 of theRehabilitation Act. In addition, windows can be navigated by the keyboard, andnew colors are now configurable. New accessible icons are also available.Power functionsNew functions give new power to extend transformations and applications.These are in addition to the 120 functions previously available: Math functions include acosine, atan, asin, cosine, cosineh, exponential, factorial,log, power, sin, sinh, sqrt, tan, tanh. Miscellaneous functions include GetLocale, GetInstallDirectory, GetResourceAlias. XML functions include ValidateXML, ApplyXSLT, XPathQuery,ChangeXMLEncoding.
IBM WebSphere Transformation Extender, Version 8.1Page 14New dynamic functions enable you to easily extend WebSphere TransformationExtender, and you can call user-defined C/C functions directly from atransformation using the same syntax and semantics as a functional map. Youcan also pass text, integers, and date and time elements to these functions. Younow have the capability to develop a cross-platform library of user-definedfunctions that behave as if they were native mapping functions.New industry packsWebSphere Transformation Extender packs have also been enhancedto deliver better performance, more function and more currency withindustry standards. IBM WebSphere Transformation Extender Pack for HIPAA EDI, Version 4.2provides updated support for the latest developments in HIPAA, includingclaims attachments. IBM WebSphere Transformation Extender Pack for X12, Version 2.7 supports thelatest X12 5030 standard. IBM WebSphere Transformation Extender Pack for EDIFACT, Version 2.7 supportsthe new EDIFACT D05A and D05B standards. IBM WebSphere Transformation Extender Pack for SWIFTNet FIN, Version 4.2supports SWIFT SRG 2006. IBM WebSphere Transformation Extender Trading Manager, Version 7.8 supportsthe latest versions of X12, EDIFACT, and HIPAA and includes an enhancedEDIFACT subsystem for increased performance.
IBM WebSphere Transformation Extender, Version 8.1Page 15Packaged offerings tailored to your integration needsWebSphere Transformation Extender is made available as a numberof basic editions tailored to the functionality needed to complete yourprojects. Each comes with a broad range of technology adapters to facilitateapplication integration. They also include support for WebSphere MQ, JavaMessage Service (JMS), File Transfer Protocol (FTP), TIBCO Rendezvous andother transport protocols.IBM WebSphere Transformation Extender (for embedding)You can use this base edition to deploy transformations in customprogramming environments. It contains the core engine with C, Java,Enterprise JavaBeans (EJB) and COBOL APIs. This edition is also suited forembedding within original equipment manufacturer (OEM) offerings.IBM WebSphere Transformation Extender with Command ServerThis base edition includes the core engine, without the APIs, but with thecapability to control how a transformation is implemented by calling thetransformation engine directly from a command line, shell script or timer. Thisedition is often used to extend an existing application and infrastructure withminimal intrusion.
IBM WebSphere Transformation Extender, Version 8.1Page 16IBM WebSphere Transformation Extender with LauncherThis is the lead edition, which includes the capabilities of IBM WebSphereTransformation Extender with Command Server and adds the full runtimeserver environment that synchronizes and controls complex datatransformation flows. The launcher activates transformations based ontriggers, which can be a file creation, a message arriving on a WebSphere MQqueue, a database management system (DBMS) trigger, a timer and many otheroptions, as well as combinations of triggers.IBM WebSphere Transformation Extender for Message BrokerThis product is equivalent to the WebSphere Transformation Extender withLauncher edition but delivered as a node within a WebSphere Message Brokermessage flow. WebSphere Message Broker users can take advantage of theadvanced capabilities of WebSphere Transformation Extender when processingin-flight messages.Figure 5. WebSphere Message Broker
IBM WebSphere Transformation Extender, Version 8.1Page 17IBM WebSphere Transformation Extender Design StudioThe design studio is where transformations and metadata are developed,imported, tested and performance-tuned. After these processes are complete,the transformation is moved to the base edition host system for system test andproduction implementation.IBM WebSphere Transformation Extender SDKWebSphere Transformation Extender SDK is a packaging of the APIs such as C,Java, EJB and COBOL, separate from the WebSphere Transformation Extenderbase edition, which also includes them. With the SDK, you can also developcustom adapters for WebSphere Transformation Extender and deploy themwith any base edition.Industry packsIndustry packs include: IBM WebSphere Transformation Extender Pack for EDIFACT IBM WebSphere Transformation Extender Pack for X12 IBM WebSphere Transformation Extender Pack for EANCOM IBM WebSphere Transformation Extender Pack for ODETTE IBM WebSphere Transformation Extender Pack for TRADACOMS IBM WebSphere Transformation Extender Pack for SWIFTNet Fin IBM WebSphere Transformation Extender Pack for SWIFTNet Funds IBM WebSphere Transformation Extender Pack for HIPAA EDI IBM WebSphere Transformation Extender Pack for HL7 IBM WebSphere Transformation Extender Pack for NCPDP
IBM WebSphere Transformation Extender, Version 8.1Page 18Application packsApplication packs include: IBM WebSphere Transformation Extender Pack for PeopleSoft Enterprise IBM WebSphere Transformation Extender Pack for SAP R/3 IBM WebSphere Transformation Extender Pack for SAP XI IBM WebSphere Transformation Extender Pack for SiebelIBM WebSphere Transformation Extender Trading ManagerThis edition enables you to manage and control the B2B integration of partnerrelationships and message flow.IBM WebSphere Transformation Extender Pack for Web ServicesThis edition extends built-in capabilities with the ability to send Web servicesrequests to an SOA service provider directly from a transformation. WebSphereTransformation Extender PACK for Web Services works with any base edition.IBM WebSphere Transformation Extender Security CollectionThis edition provides other adapters to encrypt and decrypt data according tomany popular standards. Adapters include Secure Multipurpose Internet MailExtensions (S/MIME), Secure Sockets Layer (SSL) and OpenPGP. WebSphereTransformation Extender Security Collection works with any base edition.
IBM WebSphere Transformation Extender, Version 8.1Page 19IBM WebSphere Transformation Extender Launcher AgentThis edition adds an inbound HTTP agent for WebSphere TransformationExtender that enables WebSphere Transformation Extender with Launcher tolisten and respond to HTTP requests. WebSphere Transformation ExtenderLauncher Agent requires the IBM WebSphere Transformation Extender withLauncher base edition.SummaryWebSphere Transformation Extender is the universal transformation enginefor both data and application integration specialists and programmers whoneed to integrate diverse and complex data sets, documents and messagesacross their enterprises. Its powerful write-once, deploy-anywhere portabletechnology enables you to grow your infrastructure with your business.Furthermore, WebSphere Transformation Extender industry PACKs enableyou to accelerate your time to market, with the confidence that your datacomplies with the latest industry formats and regulations.For more informationTo learn more about the IBM WebSphere Transformation Extender family ofproducts, contact your IBM representative or IBM Business Partner, or visit:ibm.com/software /integration/wtxTo join the Global WebSphere Community, visit:www.websphere.org
Copyright IBM Corporation 2006IBM CorporationSoftware GroupRoute 100Somers, NY 10589U.S.A.Produced in the United States of America09-06All Rights ReservedCICS, ClearCase, DataStage, IBM, the IBM logo,IMS, Rational, System z, WebSphere and z/OSare trademarks of International Business MachinesCorporation in the United States, other countries orboth.Microsoft and Windows are trademarks of MicrosoftCorporation in the United States, other countries orboth.Java and all Java-based trademarks are trademarksof Sun Microsystems, Inc. in the United States, othercountries or both.UNIX is a trademark of The Open Group in theUnited States, other countries or both.Linux is a registered trademark of Linus Torvalds inthe United States, other countries or both.Other company, product and service names may betrademarks or service marks of others.* The adapters not included are those for connectionto Web services and encryption protocols.WSW11256-USEN-00
IBM WebSphere Transformation Extender, Version 8.1 Page Value proposition WebSphere Transformation Extender is designed to meet the needs of information- and application-integration arch