[Logo] SpagoWorld Forums
  [Search] Search   [Recent Topics] Recent Topics   [Hottest Topics] Hottest Topics   [Members]  Member Listing  
[Groups] Back to home page  [Moderation Log] Moderation Log   [Register] Register /  [Login] Login 
Can't create ETL Talend document  XML
Forum Index » Technical Help - SpagoBI Server - ETL
Author Message
fcarta.spw



Joined: 05/09/2012 15:09:35
Messages: 4
Offline

Hi,
I did an ETL Talend job, it was successfully deployed to SpagoBI server.
I have created a document on spagobi (Analytical Model -> Documents development):
Type ETL Process
Engine Talend Engine

Template spagobi.xml (resources\talend\RuntimeRepository\java\ProvaCorso\Clean_Audit)

but when I save it, template became blank, "spagobi.xml" disappear.
If I run the document it gives me an error "Error while executing job"

Could anyone help me?
thanks in advance
Fede
fcarta.spw



Joined: 05/09/2012 15:09:35
Messages: 4
Offline

I solved,
the problem wasn't in the desappearing of the Template file name (it is normal, it works even it doesn't appear after saving document),
but there was an error into engine-config.xml file configuration

<JNDI_THREAD_MANAGER>java:/comp/env/wm/SpagoWorkManager</JNDI_THREAD_MANAGER>

<!--JNDI_THREAD_MANAGER>wm/SpagoWorkManager</JNDI_THREAD_MANAGER--> ERROR!!!

end when I correct it, I didn't restart SpagoBI server!

bye
Fede

This message was edited 1 time. Last update was at 05/09/2012 16:26:23

d.synchronized@gmail.com.spw

SpagoBI friend

Joined: 14/12/2012 05:15:51
Messages: 98
Offline

hey can you tell me the significance of the etl process ? why we are using it ..

i created one my self ,but i was wondering if in case i have the rights on the db?
moreover everytime i run the etl document ,it increments the rows in db


say i was taking the data from

db1(source)
.............. .......=>db3(target) then whenever i run the doc if 15 rows get transfered ,it increment it like 15+15 den other time again if run 30+15? is this the right way?
db2(source)

please help thanks in advance
Dishant

This message was edited 1 time. Last update was at 09/01/2013 09:46:28

fcarta.spw



Joined: 05/09/2012 15:09:35
Messages: 4
Offline

Hi,
ETL means Extraction Transformation and Loading data, from a source db to another different target...

In your target (db3) are there primary keys?
You must declare primary keys in your tables, so you can overwrite records with same primary keys everytime you load data from db1 to db3

bye
Federico

d.synchronized@gmail.com.spw

SpagoBI friend

Joined: 14/12/2012 05:15:51
Messages: 98
Offline

like say in one table(t1)
id=>primary key

in second(t2)
subject_code=>primary key

now the the third table
t1.id
t2.subjectname


what should be the primary key here ?? and if i made this primary key here ? den it wont make the copy of the data ,presently if it copies 15 rows into t3
,den when i execute the document it makes anyother copy 15+15=30 and like this everytime ..so if i make primary key ? will this problem be solved?

and i wud have used the simple joins insteadd of using the etl? whats the purpose of doing this ?
terje.spw


[Avatar]

Joined: 05/06/2012 15:19:35
Messages: 9
Location: Oslo, Norway
Offline

d.synchronized@gmail.com.spw wrote:hey can you tell me the significance of the etl process ? why we are using it ..

i created one my self ,but i was wondering if in case i have the rights on the db?
moreover everytime i run the etl document ,it increments the rows in db


say i was taking the data from

db1(source)
.............. .......=>db3(target) then whenever i run the doc if 15 rows get transfered ,it increment it like 15+15 den other time again if run 30+15? is this the right way?
db2(source)

please help thanks in advance
Dishant


Hi - Double Click the component for saving into your database in TOS/DI (ususally the last component in the ETL-job)

Here your can select what action is to be taken on your table when the job is executed. The options are:

None
Drop and create table
Create Table
Create Table if not exist
Drop table if exists and create
Clear table
Truncate table

Select an option that will erase your old data, if that is what you want (e.g. Truncate table)

You can also select what action is to be taken on the data. The options are:

Insert
Update
Update or Insert
Insert or Update
Delete


This message was edited 1 time. Last update was at 11/04/2013 17:05:32

[WWW]
 
Forum Index » Technical Help - SpagoBI Server - ETL
Go to:   
Powered by JForum 2.1.9 © JForum Team