Bobj Ds & Bw Connection

Getting Started Newsletters Store

Products Services & Support About SCN Downloads

Industries Training & Education Partnership Developer Center

Lines of Business University Alliances Events & Webinars Innovation

Login RegisterWelcome, Guest

Activity Communications Actions

Browse

Tweet 0

created by Pierre Erasmus on Jun 23, 2012 8:47 AM, last modified by Pierre Erasmus on Jun 23, 2012 11:08 AM

Introduction

This document describes the configuration of BOBJ DS (Data Service) and SAP BW (Business Warehouse)Netweaver. This configuration manual can also be used for solutions that are running on top of the BWenvironment such as DSiM where there is a special need for data cleansing and harmonization before beingloaded into a solution operating as BI Content.

This how to guide provide configuration steps for creating a RFC connection between DS and BW. Thisincludes configuration advice to which connection type to use and how to configure it. This manual alsoprovide some best practice and problem solving techniques to avoid costly problem solving, workaroundsand error handling that is most apparent using the new BO DataService source type.

Prerequisites

Application Versioning

SAP Data Service 4.0Designer 14.0.2.435JobServer 14.0.2.435JobEngine 14.0.2.435

SAP BW 7.31SAP NOTE 1727378

Installation

SAP Business Objects Data Services 4.0 Support Pack 2 (14.0.2.0)

Background for Data Service - BW data transfer

The Data Services tools can be used into the SAP BI staging process, especially for Non-SAP data.

Following is the procedure for using Data Services features into the SAP BI staging process -

1) Load the non-SAP data in the Data Services engine.2) Perform Data Quality operations on the data in Data Services.3) Load the data into SAP BIThere are two ways for DS Data Upload to BW:

1) Data Upload to BW is controlled by BW2) Data Upload to BW is controlled by Data Services

In the first case you manually create the InfoPackage. Here you leverage the simplification brought by BO DataServices Source-system-type in BW. You need to fill the jobname (or it will be generated by BW, if you enter a datastore in the source system attributes), since that job will be started in data services, when the InfoPackage is started.

In the second case, the job is started already by BO Data Services. It will generate a DS-Generated InfoPackage onlybecause BW needs it to have an object, where BW can attach the BW data load request. After generation of theInfoPackage BO Data Services remotely starts the InfoPackage and gets back this data load request. With that requestdata services now can start sending data to BW. Hence the call of the InfoPackage into BO Data Services (which alsohappens when the InfoPackage is started remotely) is ignored on the BO Data Services side.

For that reason, the contents of the InfoPackage are completely irrelevant in the second case. But if you misuse such apackage for the first case, then BO Data Services gives you an error, because it generate these placeholderInfoPackage in a way, which is inconsistent for itself (because at intended usage the contents is ignored (BO dev-teamin Palo Alto).

BW Creating a RFC connection

BOBJ Data Services and Netweaver BWShareShare 0LikeLike

Version 3

BOBJ Data Services and Netweaver BW | SCN http://scn.sap.com/docs/DOC-29394

1 of 10 4/8/2014 10:18 PM

Connecting SAP BI with Data Services

In order to allow the exchange of data and meta data between SAP BI and Data Services, we have to first establish aconnection between both the systems.

On the SAP BI side this is achieved by creating a source system (External Source System in older versions BW 3.X) andin Data Services we have to create a new DataStore. Please note that a new type of Source System is now available inBW 7.3X called BO DataServices. This should allow for better performance during data transfers.

Enter the SAP BW application.

Goto Transaction RSA1

Select Source Systems in the Modeling navigation pane on the left.Navigate to BO DataServices right click and select create.

Enter Logical System Name and Source System Name as shown above and hit Continue.

Data Services will start an RFC Server program and indicates to SAP BI that it is ready to receive RFC calls. To identifyitself as the RFC Server representing this SAP BI Source System a keyword is exchanged, in the screen shot below it is"BOE_DS_SRY_vmw4698". This is the Registered Server Program, the Data Services RFC Server will register itselfwith at SAP. Therefore, provide the same Program ID that you want to use for the call of the RFC Server on DataServices side. All other settings for the Source System can remain on the default settings. To complete the definition ofthe Source System, save it.

BO Data Service - Configure a RFC connection

In this section we will create establish the Source System and start the RFC Server on the Data Services side. Sinceversion 3.2 of DataServices this RFC server is folded into the Management Console.

So we start the Management Console, ( selecting the button in the DS Designer) expand to the new "SAPConnections" node and open the "RFC Server Interface" item. In the Configuration tab a new RFC Server is added sothat it can register itself inside the SAP System with the given PROGRAM_ID.


2 of 10 4/8/2014 10:18 PM

Start the RFC server

BW - Test the RFC Connection

Login the SAP BW application.

Goto Transaction SM59Select the folder TCP/IP connections and double click on the RFC connection.

Click on Connection Test.


3 of 10 4/8/2014 10:18 PM

The connection will display if successful or not.

Create the BW Data Sources

Login the SAP BW application.

Goto Transaction RSA1

Navigate to Source Systems under Modeling and double click the created BO DataService connection.Right click on Source Systems (RFC connection) and then create or map the data sources needed with a certain RFCconnection. BI Content can also be activated and installed for this scenario and the schema or data structure (Meta data)will be visible in DS.

BW as target source in BO Data Services

Login the SAP BO Data Service Designer.

The SAP BO Data Service Designer will be used to create jobs and queries for data harmonization and cleansing.

Now we would like to map and select the created Master and Transaction data sources.In the BO Data Service Designer Local Object Library double click on the created DataStore.

Import the BW data sources by selecting the Master/Transaction transfer structures accordingly. You can only selectimport in the branches of the tree structure.

Import all the Data Sources form BW which you would like to populate using DataServices.

Important to know BW 7.30 Data Services XI4.0

There are two ways one can schedule or execute a BW Load Job:

1) BW Load Job is scheduled or executed from Data Services system. In this case you should create a BODS SourceSystem (SAPDS_SOURCE) in SAP BW system (RSA1) with no attribute set. It points to (or correspond to) aseparate RFC Destination (SM59), for example SAPDS. SAPDS may point to program ID DSPROGID.

a.

2) BW Load Job is scheduled or executed from the BW system. In this case you should create another BODS SourceSystem (SAPBWDS_SOURCE) in SAP BW system (RSA1) with attribute set. It points to (or correspond to) aseparate RFC Destination (SM59), for example SAPBWDS. SAPBWDS may point to DSPROGID.

b.

If you dont set the attributes, then you need to provide a repository name, jobserver name and jobname in InfoPackage 3rd party parameter section.

a.


4 of 10 4/8/2014 10:18 PM

This option also give SAPGUI user to automatically create BW DataSource which get the structure from sourcetable like Oracle. Please refer to external sources section below.

b.

External Sources via BW 7.30 Data Services XI4.0

BW 7.30 and Data Services XI 4.0 has a modeling integration, where you do not need to leave BW Data WarehousingWorkbench at all in order to connect to any of these external systems and get the data out! But of course, since DataServices still is a separate installation, there are some prerequisites, which you need to do on data services in order tobe able to retrieve remote function calls from your BW system.

Open up the Data Services Management Console,

Log in and go to the Administrator Section. What you need first and foremost, is an SAP connection, i.e. an RFC serverlistening to BW:

Log in and go to the Administrator Section and go to the RFC Server Interface Configuration and add a connection.

The type of connection on ABAP side is a registered server program and the logon data you enter is needed to registerthis program on the SAP application server. For that reason, you need a separate RFC server configuration per SAPapplication server in data services. Give them all the same RFC ProgramID and make a note of it. In this example weuse DI_GEMINI. You will need it later when you do the inverse connection from BW to Data Services.

Now login to your BW data warehousing workbench and connect using an external system. Start with the source systemarea of data warehousing workbench: In this example we are connecting to a MySQL Database.

Now we the .as we want to connect to a ( ) MySQL-Database and call asource system DB resp. For example a Sales Database.

Once creating a source system of type xternal System you enter the RFC program ID, which you had named yourRFC servers, You can access this via transaction SM59 TCPIP. If you maintained the SNC settings in the RFC server,switch to the Logon & Security tab and check the radio button Send Logon Ticket without Ref. to a target system:


5 of 10 4/8/2014 10:18 PM

Save and test

When you leave the screen two screens should appear. You need to enter the name of the repository of your dataservices system and the name of the Job Server You may use the value help for the exact naming.

.

The second attributes window will appear where one define Data services object data store To define this onerequire a username and password to logon to the BW. In order to access the business data on my MySQL database,one has to define another data store via data services. This time it is a source data store (a data store might be sourceor target).

In case there is no data store available which connects to the external database (MySQL), one can enter a new nameinto the input field and press the create button. The system prompts which data store type to use? In this exampleMySQL is a relational database management system without change -delta capture therefore we selectRDBMSDataStore, and not CDCRDBMSDataStore. The configuration name column becomes available. In thisexample the configuration is automatically named DEFAULT. But the type of configuration one needs to choose with thevalue help.


6 of 10 4/8/2014 10:18 PM

The DataSource is in this case an ODBC-Datasource not BW DataSource. Because the MySQL database is accessedvia ODBC technology, one should enter the name of the database, a username and password to connect to thedatabase. For entering the password, click on the input field and obtain another popup where we can enter thepassword. Confirm all popups and the system will go to data services and create the two mentioned data stores andstore their names and the name of the repository and job server as attributes of the source system in BW. The data storeconfiguration itself will not be stored in BW but one can change it by clicking on the edit button in the source systemattributes, it then will be retrieved from data services (BW dev-team Walldorf).

Typical errors and support

For errors related to invalid Jobname parameter in a DS generated InfoPackage in BW please follow the followingworkaround to remove the repository name in BW.

Go to transaction SE16.Open the table RSBOBJDS_LOGSYSRemove entries for REPOSITORY, JOBSERVER column for BO DS Source System.Delete the DS generated InfoPackages and run the DS jobs again to create new ones.

You can also refer to SAP NOTE 1727378

In some documents the authors provide advice to complete the respository and jobname which could be misunderstood,in this case (using DS generated IP) will lead to a follow-up error as displayed below.

Therefore for DS generated InfoPackages using type BODataservice data source. It should remain empty as indicated below.


7 of 10 4/8/2014 10:18 PM

Average User Rating

(5 ratings)

Tweet 0

PS Its important to remember that one .

Author and Editor

Pierre Erasmus

Copyright/Trademark

Document references

http://wiki.sdn.sap.com/wiki/display/EIM/Run+the+DataServices+3.2+RFC+Server

http://wiki.sdn.sap.com/wiki/display/BOBJ/How+To+Use+BusinessObjects+Data+Services+in+SAP+BI+staging+process

http://scn.sap.com/people/thomas.rinneberg/blog/2011/03/03/bw-730-modeling-integration-between-sap-business-objects-data-services-and-bw-part-1-of-2-connect-source-system

19303 Views Tags: hana, bw, and, data, dataservices, dervice

ShareShare 0LikeLike

12 Comments

Like (0)

Neil Phillips Jun 25, 2012 5:26 PM

do you have such info for connecting Data Services Version: 12.2.3.4 to SAP BW 3.5 .We've made a successfull RFC connection but have an issue where a transaction load times out in BW. Jobcompletes successfully in DS but stays in a state of wating to complete in Infopackage after a partial load. Noerrors. We're using the Console RFc connection with relevant 3rd part settings - job starts and runs ; masterdata loads fine.

Like (0)

Pierre Erasmus Jul 1, 2012 2:00 PM (in response to Neil Phillips)Hi Neil

There is diffirent ways how you can trouble shoot this. I would suggest you start with followingthe steps to create (re create) and test your RFC connection from both DS and BWside.Sometimes you get more detail on in the DS admin logs. This blog show you how to testthe connection from both sides. Also it show you how to create the RFC connection ofexternal type. If you had done this and still no luck try to follow the alternative route to executea DS job from inside BW. You can create a InfoPackage where you have to complete the 3rdparty Jobnname and respository name. For a DS generated InfoPackage you dont have tocomplete the 3rd party details as in this case the IP is only recieving data.

For the older RFC connection procedures please refer to the reference links in this blog that isfocus on type External DataSource system.

Let me know if you found a solution and if I can be of more assitance.

Thank youBest regardsPierre


8 of 10 4/8/2014 10:18 PM

Like (0)

Anton Olkhovik Oct 5, 2012 5:16 PM

Dear Pierre,

Thank you for writing this document! It really helped to solve the issue with "invalid value with jobnameparameter".

wbr,Anton Olkhovik

Like (0)

Mikhail Budilov Oct 14, 2012 9:37 PM

Good job, Pierre.

Thank you.

Like (0)

Mikhail Budilov Oct 14, 2012 11:31 PM

Does DS works only with InfoSources 3.x ?

Like (0)

Praveen Billa Jun 5, 2013 1:43 PM

Thanks for writing the doc...much helpful

Like (0)

ric Ledu Jun 20, 2013 4:55 PM

thank you very much for the very useful document. Everything is well explained !

Like (0)

sagar dixit Jul 8, 2013 2:09 PM

Hi,

I have followed same above steps to establish connection between BOBJ data service and BWSystem. I am to create data source using database repository into BW system. also carried out allmappings required in Data services side.

Try to pull data into bw system using infopackage,but getting below st22 dump.

Category :XSLT Runtime ErrorRuntime Errors : XSLT _BAD_SOURCE_CONTEXTExpection :CX_XSLT_RUNTIME_ERROR

Short Text :XSLT :No Valid XML Source.

Can you help us on this.

Thanks in advance.

Like (0)

David Molush Sep 13, 2013 10:19 PM

Pierre: Tell me. What type of personnel should be doing such configuration. I realize there can be amix of personnel involved in setting up all of this, however, what would be really good is to renumberyour paragraphs and sub-paragraphs and insert the paragraphs and sub-paragraph numbers into asmall table. Then assign a role to each numbered paragraph and sub-paragraphs depictingresponsibilities in each paragraph and sub-paragraph.

A good reason for this would be to delineate responsibilities. I realize it would not be perfect and therecan be gray areas but it would be a big help.

Like (0)

David Molush Sep 14, 2013 12:04 AM

Pierre:Also, indicating that Function Modules need to be imported (if not already on the system; I had a BW731 system that did not have that; had to import into the BW system) and authorization objects thatSecurity needs to include in the appropriate role(s) for the RFC user ID.

Some listing of those aspects as well. A great article overall and a big help. Kudos to you and thanks.

Like (0)

Neil Phillips Sep 19, 2013 4:41 PM

Good to remember to re-import target schemas into data services from each BW environment you useas you move your build into prodcution.

Guillaume Blanchard Sep 24, 2013 7:22 PM

Hi Pierre,

True life saving document, but i have one issue :


9 of 10 4/8/2014 10:18 PM

Follow SCNSite Index Contact Us SAP Help PortalPrivacy Terms of Use Legal Disclosure Copyright

Like (0)

The RFC connexion is working perfectly but the BW system often goes down for maintenance orpatching : this unavaibility cause the loss of the RFC connexion

We modified the SAP Gateway Connection count to 99 in the DS Management console, which delayedthe loss but didn't fix the issue. The 99 retries allow the connection to stay alive but not long enough.How can i deal with this issue ?Thanks a lot


10 of 10 4/8/2014 10:18 PM

Documents

Bobj Ds & Bw Connection