Comments on: Informatica Issue

By: Nitin

Nitin — Thu, 25 Nov 2010 11:18:06 +0000

Hi all,
I am facing a problem in Informatica. I have to execute SELECT statement stored in a flat file in informatica. I tried SQL transformation, but not sure how well it fits into the solution, i am looking for. The problem is:
I have a flat file in which i have 20 select statements for twenty different tables. Now i want to execute one select statement from the .txt file to load the output of that select stmt in to a column in target table using informatica and subsequently for remaining 19 Select stmts. So is there any way i can execute SELECT stmt from flat file.

Need your suggestion.

Thanks in advance,
Nitin

By: Shivam

Shivam — Mon, 29 Mar 2010 07:14:52 +0000

Hi Thanks,
I agree your words but what the are the other possibilities ,so that change control process
is also a factor keeping in mind

Thanks for your paitence in guoding me ,I appreciate it

Shivam

By: Administrator

Administrator — Mon, 29 Mar 2010 03:06:59 +0000

seems fine. try it out. it should work. I personally don’t like the idea of such automation. I am all for automation but change control processes are also important as a product/project matures.

By: Shivam

Shivam — Mon, 29 Mar 2010 02:53:29 +0000

Hi
I may be wrong on dynamic part ,just elimating columns or entities
May i know the steps to map or proceess for the desired output

By: Administrator

Administrator — Mon, 29 Mar 2010 01:54:54 +0000

@Shivam
How often are you expecting these changes? And why do you have to make this dynamic? What’s going to happen to all the stored procs, reports, feeds that are written based on the structure? are you going to make all of that dynamic too?

By: Administrator

Administrator — Sun, 28 Mar 2010 15:23:29 +0000

@Nitin
I would need more details about your mapping. but a few things you can check for are: table indexes, table locks, connections etc.
you can search for “performance tuning” on this site and see if it gives you any ideas.
let me know if you have more questions.

By: Shivam

Shivam — Sun, 28 Mar 2010 05:12:59 +0000

Hi kirtan this what they are expecting;–

One point to be noted that we are not looking for “runtime” manipulation of metadata for target schema or the process flow.

Based on customer specific requirements for target schema variation (elimination of columns or entities), we should be able to generate from scratch or tweak master metadata for target schema map or process flow to generate desired output. This is still considered as “design” time, just that on-site person is not using GUI tools to design the process flow rather our infrastructure will generate it.

Based on your evaluation, does Talend and Pentaho support this?

I will need to answer this from Imformatica perspective.

_______________________________________________________________________________________________________________________________________________________

Our Analysis:——————

steps:—

1. Create table control_load
2. Add 3 columns like tab_name,column_name,flag
3.Develop map to generate the parameter file where flag = ‘Y’ with parameter
as INSERT statement( for those columns or table you dont want make the flag as ‘N’)
4. Develop the actual map, after source add SQL transformation and call the parameter
for Inserting to target tableflow make dymamic for SQL transformation
5.In work

two mappings one workflow, call sessions in sequential mode
it covers both scenarios
based on flag you can do that
it all depends on how you’ll set the flag

Kirtan, make changes to the steps if i m wrong
Shivam

By: Nitin

Nitin — Fri, 26 Mar 2010 16:49:10 +0000

Hi,

I am running a workflow, in this workgflow there are 2 session. one session is for loading data from file into staging table and 2nd session for loading data from staging into fact table.
first session is running fine , but when i run the 2nd session which has 65k records to load, it keep running for 1-1.5 hrs withour any error message, only message i found in logs is “CONNECTING to DATABASE” i checked every level in db i.e. checked the temp tablespace it has enough space.. and there’s no lock on the target table.
Need your support on this issue.

thanks in advance,
Nitin

By: Sangram Takmoge

Sangram Takmoge — Sun, 06 Dec 2009 09:33:39 +0000

Hi Mahendar, Can you please let me know how would the ‘rowval’ variable get updated?

By: Mahendar

Mahendar — Mon, 05 Oct 2009 06:45:08 +0000

Hello,
There are couple of steps to load the data.
First, create a variable name “rowval” and assign 0 to that initially.
Step 1: configure the source qualifier(default)
step 2: sort the the record by some unique identifier if it have.
step 3: create sequence generator transformation take the output to expression and similarly output of sorting transformation to the expression transformation.
step 4: configure filter transformation with condition sequence_col > rowval and sequence_col <= (rowval+10)
step 5: connect the output from the filter to the target