BOB: Business Objects Board
Not endorsed by or affiliated with SAP

Register | Login 

Follow BOB on Twitter! 
Follow BOB on Twitter! (Opens a new window)  

General Notice: No events within the next 45 days.

How to retrieve limited data on a multi join?


 
Search this topic... | Search DI: Designer and Job Design... | Search Box
Register or Login to Post    Forum Index -> Data Integrator -> DI: Designer and Job Design  Previous TopicPrint TopicNext Topic
Author Message
koolhyd
Forum Member
Forum Member



Joined: 23 Oct 2019

Posts: 1



PostPosted: Wed Oct 23, 2019 9:10 pm 
Post subject: How to retrieve limited data on a multi join?

Hello ,
I am basically trying to retrieve data from salesforce and build a csv based on certain criteria. But then way i designed it takes a ridiculously long time as all the tables are 1M+ rows. But the query that i can run directly in sql server (which has a copy of the SF database) takes less than 5 secs.

the query i intend to design in DS is..
select A.id, A.name, b.lift, c.qty, c.name from table1 A, table2 B left outer join table3 on b.id = c.name
where a.type = 'Helsinki'
and a.createddate > getdate()-5

in my DS, the end result is correct, but every query transform is retrieving the entire table and its taking alteast an hour to run the job.

Please advise on how to retireve data where i can get the DS to query the database directly, rather than retrieve the entire table and then perform the filters ?
Back to top
Display posts from previous:   
Register or Login to Post    Forum Index -> Data Integrator -> DI: Designer and Job Design  Previous TopicPrint TopicNext Topic
Page 1 of 1 All times are GMT - 5 Hours
 
Jump to:  

Index | About | FAQ | RAG | Privacy | Search |  Register |  Login 

Get community updates via Twitter:

Not endorsed by or affiliated with SAP
Powered by phpBB © phpBB Group
Generated in 0.0322 seconds using 17 queries. (SQL 0.0032 Parse 0.0009 Other 0.0282)
CCBot/2.0 (https://commoncrawl.org/faq/)
Hosted by ForumTopics.com | Terms of Service
phpBB Customizations by the phpBBDoctor.com
Shameless plug for MomentsOfLight.com Moments of Light Logo