BOB: Business Objects Board
Not endorsed by or affiliated with SAP

Register | Login 

Want to sponsor BOB? 
Want to sponsor BOB? (Opens a new window)  

General Notice: BOB is going to retire...please see details here.
General Notice: No events within the next 45 days.

[BI 4.x] Cloudera Impala
1 members found this topic helpful
Goto page 1, 2  Next
 
Search this topic... | Search XI Server Discussion... | Search Box
Register or Login to Post    Forum Index -> Server Administration, Installation, Upgrades -> XI Server Discussion  Previous TopicPrint TopicNext Topic
Author Message
Nick Daniels
Forum Aficionado
Forum Aficionado



Joined: 15 Aug 2002

Posts: 14239
Location: England


flag
PostPosted: Fri Sep 25, 2015 1:02 pm 
Post subject: Cloudera Impala

BI4.1 SP6 on Redhat......and I'm interested to see if anyone has got connectivity working with either odbc or jdbc and Cloudera Impala.
Back to top
Nick Daniels
Forum Aficionado
Forum Aficionado



Joined: 15 Aug 2002

Posts: 14239
Location: England


flag
PostPosted: Tue Sep 29, 2015 1:01 pm 
Post subject: Re: Cloudera Impala

Well the answer is that we have.....locally odbc or jdbc, server side jdbc only. We found that the url format in the hive.sbo file was the key to it all. In particular, referencing an impala.jks file in a path with no spaces in any folder names (local) and specifying the user name and password as the last two parameters separated by a comma, whereas all the others are separated by a semi colon.
Back to top
ABILtd
Forum Enthusiast
Forum Enthusiast



Joined: 08 Feb 2006
ASUG Icon
Posts: 1889


flag
PostPosted: Wed Sep 30, 2015 4:08 am 
Post subject: Re: Cloudera Impala

Nick Daniels wrote:
Well the answer is that we have.....locally odbc or jdbc, server side jdbc only. We found that the url format in the hive.sbo file was the key to it all. In particular, referencing an impala.jks file in a path with no spaces in any folder names (local) and specifying the user name and password as the last two parameters separated by a comma, whereas all the others are separated by a semi colon.


Nice to hear some out there are using BO with HADOOP! I was going to set something up at home for self learning on top of my small HADOOP cluster (** geek **).

Good info too.

_________________
BI and Analytics Presales Consultant
------------------------------------------------------
BOXI R1, R2, R3, R3.1, R4.1, R4.2, CE 8, 8.5, 9, 10, SAP Analytics Cloud, Crystal Reports, Lumira, PowerBI, Tableau, JasperServer, iReport, LogiAnalytics, BIRST, Qlikview, Xcelcius, Netezza, T-SQL, PLSQL, DTS, SSIS, BODI, BODS, Kimble etc....
------------------------------------------------------
Back to top
Nick Daniels
Forum Aficionado
Forum Aficionado



Joined: 15 Aug 2002

Posts: 14239
Location: England


flag
PostPosted: Thu Oct 01, 2015 1:21 pm 
Post subject: Re: Cloudera Impala

It is interesting to work with billions rather than millions of rows! In terms of the .jks path, if you put it in double quotes in can include spaces. Commas and semi colons seem to be interchangeable. I'm currently wrestling with IDT versus UDT....UDT only sees the default schema, IDT sees it all. But IDT struggles with tables not in the default schema so you have to wrap everything up as derived tables. Next stop, subject to approval is (gasp) real time data....
Back to top
ABILtd
Forum Enthusiast
Forum Enthusiast



Joined: 08 Feb 2006
ASUG Icon
Posts: 1889


flag
PostPosted: Fri Oct 02, 2015 4:58 am 
Post subject: Re: Cloudera Impala

Nick Daniels wrote:
It is interesting to work with billions rather than millions of rows! In terms of the .jks path, if you put it in double quotes in can include spaces. Commas and semi colons seem to be interchangeable. I'm currently wrestling with IDT versus UDT....UDT only sees the default schema, IDT sees it all. But IDT struggles with tables not in the default schema so you have to wrap everything up as derived tables. Next stop, subject to approval is (gasp) real time data....


You should blog this for those of us still stuck with 'normal' databases.

Blazing the trail icon_surprised.gif

_________________
BI and Analytics Presales Consultant
------------------------------------------------------
BOXI R1, R2, R3, R3.1, R4.1, R4.2, CE 8, 8.5, 9, 10, SAP Analytics Cloud, Crystal Reports, Lumira, PowerBI, Tableau, JasperServer, iReport, LogiAnalytics, BIRST, Qlikview, Xcelcius, Netezza, T-SQL, PLSQL, DTS, SSIS, BODI, BODS, Kimble etc....
------------------------------------------------------
Back to top
Nick Daniels
Forum Aficionado
Forum Aficionado



Joined: 15 Aug 2002

Posts: 14239
Location: England


flag
PostPosted: Fri Oct 09, 2015 4:24 am 
Post subject: Re: Cloudera Impala

Ha, well server side connectivity is in fact NOT working. Curse you IDT....so on the Java side we have a local connection working fine. When we attempt the same via the server we get this:
Code:
Fail to create an instance of Job : com/cloudera/impala/jdbc41/Driver : Unsupported major.minor version 51.0
It layman-speak that means it needs Java 7. We made the change, but it had no effect.
On the ODBC side we have a local connection working and we also have a 64 bit Impala DSN working on the server via isql. But! When we try via IDT using server side connectivity we get this:
Code:
FatalException occured. The cause was : com.crystaldecisions.enterprise.ocaframework.OCAFrameworkException$AllServicesDown: Unable to find servers in CMS servername.domain.net:6400 and cluster @servername.domain.net:6400 with kind connectionserver and service propertyListContains('SI_NETWORK_LAYERS', '[ODBC][Cloudera Impala 1.0 Simba ODBC]'). All such servers could be down or disabled by the administrator. (FWM 01014)

Now, if we look at the relevant server service in the CMC or use the following query builder code select * from ci_systemobjects where si_server_kind='connectionserver' we can plainly see those exact details.

So the quest continues, we have raised this with SAP and also have a list as long as my arm of things to check.
Back to top
Nick Daniels
Forum Aficionado
Forum Aficionado



Joined: 15 Aug 2002

Posts: 14239
Location: England


flag
PostPosted: Wed Oct 14, 2015 7:13 am 
Post subject: Re: Cloudera Impala

WE DID IT! Cloudera Impala ODBC 2.5.29....the final error related to a line commented out in bigdata.sbo...I'll post the details later. How an error about si_server_kind is supposed to help work that out I do not know.

We've seen some limited data - doesn't like strings at all, doen't like more than about 1500 rows of data - END_SQL=LIMIT 1000 at the moment....watch this space icon_cool.gif
Back to top
Nick Daniels
Forum Aficionado
Forum Aficionado



Joined: 15 Aug 2002

Posts: 14239
Location: England


flag
PostPosted: Thu Oct 15, 2015 5:32 am 
Post subject: Re: Cloudera Impala

Today's update. We've got round a problem with character columns, they have to be 'cast' as LongText or have a Trim put round them. But, we've hit a limit on the amount of data that can be brought back. Initially it seemed to be about 16Kb but we've got up to about 32Kb now. If you don't set a LIMIT n on the end of the SQL it failes with
Code:
Your session timed out.  Close the Java interface and log on again.

Do it via the HTML viewer and its the generic
Code:
An internal error occurred while calling 'processDPCommandsEx' API. (Error: ERR_WIS_30270)

A Show Table Values through IDT gives us
Code:
recv() returned zero

We've observed that the WIPS fail following this error, or certainly a number of occurences of it.
Back to top
Andreas
Forum Advocate
Forum Advocate



Joined: 20 Jun 2002

medal_silver.gif*2medal_gold.gif
Posts: 17346
Location: *** BEEP ...Dreaming of Africa... leave No message ; ) BEEP ***


flag
PostPosted: Thu Oct 15, 2015 11:50 am 
Post subject: Re: Cloudera Impala

That is looovelie..
Thank you for the updates though!

_________________
Follow me on Twitter
Reading "The Design Of Everyday Things" by Don Norman
Focusing on Data Visualization, Design Thinking, SAP DesignStudio + scripting, SAP BI 4.x platform & architecture, SAP connectivity, Data Modeling, and SAP HANA Certified Associate
Back to top
Nick Daniels
Forum Aficionado
Forum Aficionado



Joined: 15 Aug 2002

Posts: 14239
Location: England


flag
PostPosted: Fri Oct 16, 2015 3:07 am 
Post subject: Re: Cloudera Impala

Andreas wrote:
Thank you for the updates though!
You are welcome...thanks for the vote icon_cool.gif

Today's update for the hell of it I've tried the IDT Query feature and QAAWS none of which get us any further. Waiting to hear from SAP...
Back to top
Nick Daniels
Forum Aficionado
Forum Aficionado



Joined: 15 Aug 2002

Posts: 14239
Location: England


flag
PostPosted: Fri Oct 23, 2015 4:12 am 
Post subject: Re: Cloudera Impala

Nick Daniels wrote:
Waiting to hear from SAP...
...still waiting. In the meantime we've checked our user account outside of BusinessObjects....DB Vizualiser over JDBC to Impala - more data than you can shake a stick at. We've setup an Oracle JDBC connection and its fine via FHS or universer (either flavour). Next week we'll look at Hive....but time is running out for BO as with Tableau it takes about 5 minutes to get access using the same credentials. Hopeful of better support in the imminent SP7 but it isn't possible to find out what new connectivity is going to be supported until the documentation is released which I guess is going to be late November.
Back to top
ABILtd
Forum Enthusiast
Forum Enthusiast



Joined: 08 Feb 2006
ASUG Icon
Posts: 1889


flag
PostPosted: Fri Oct 23, 2015 5:44 am 
Post subject: Re: Cloudera Impala

Nick Daniels wrote:
Nick Daniels wrote:
Waiting to hear from SAP...
...still waiting. In the meantime we've checked our user account outside of BusinessObjects....DB Vizualiser over JDBC to Impala - more data than you can shake a stick at. We've setup an Oracle JDBC connection and its fine via FHS or universer (either flavour). Next week we'll look at Hive....but time is running out for BO as with Tableau it takes about 5 minutes to get access using the same credentials. Hopeful of better support in the imminent SP7 but it isn't possible to find out what new connectivity is going to be supported until the documentation is released which I guess is going to be late November.


Are you doing this in a POC style environment then Nick?

_________________
BI and Analytics Presales Consultant
------------------------------------------------------
BOXI R1, R2, R3, R3.1, R4.1, R4.2, CE 8, 8.5, 9, 10, SAP Analytics Cloud, Crystal Reports, Lumira, PowerBI, Tableau, JasperServer, iReport, LogiAnalytics, BIRST, Qlikview, Xcelcius, Netezza, T-SQL, PLSQL, DTS, SSIS, BODI, BODS, Kimble etc....
------------------------------------------------------
Back to top
Nick Daniels
Forum Aficionado
Forum Aficionado



Joined: 15 Aug 2002

Posts: 14239
Location: England


flag
PostPosted: Fri Oct 23, 2015 5:51 am 
Post subject: Re: Cloudera Impala

Its on the dev server. Less power but very close to the clients' live setup. Its a fast moving place so one week we're talking Impala the next its Spark etc
Back to top
Nick Daniels
Forum Aficionado
Forum Aficionado



Joined: 15 Aug 2002

Posts: 14239
Location: England


flag
PostPosted: Mon Nov 16, 2015 3:10 am 
Post subject: Re: Cloudera Impala

And today's update? We switched the underlying database account to one with more rights and suddenly IT ALL WORKS. Hoorah....
Back to top
Nick Daniels
Forum Aficionado
Forum Aficionado



Joined: 15 Aug 2002

Posts: 14239
Location: England


flag
PostPosted: Wed Nov 25, 2015 2:36 pm 
Post subject: Re: Cloudera Impala

This client is great! So we run a schedule every 30 minutes to trigger a refresh of two key tables - bring them up to date. That's done in a program object that just issues refresh table commands. That then triggers the run of report which highlights certain information of interest to a key area of the business. And as if that wasn't good enough, we've started on looking at some of the worst Oracle queries....you know those ones that run for 15 minutes when it is quiet but over an hour when its busy? We've got something like 10 to 20 times performance improvements...and that's hacking the Oracle SQL in to something Impala will deal with without any refining. Exciting!
Back to top
Display posts from previous:   
Register or Login to Post    Forum Index -> Server Administration, Installation, Upgrades -> XI Server Discussion  Previous TopicPrint TopicNext Topic
Page 1 of 2 All times are GMT - 5 Hours
Goto page 1, 2  Next
 
Jump to:  

Index | About | FAQ | RAG | Privacy | Search |  Register |  Login 

Get community updates via Twitter:

Not endorsed by or affiliated with SAP
Powered by phpBB © phpBB Group
Generated in 0.1183 seconds using 18 queries. (SQL 0.0276 Parse 0.0588 Other 0.0319)
CCBot/2.0 (https://commoncrawl.org/faq/)
Hosted by ForumTopics.com | Terms of Service
phpBB Customizations by the phpBBDoctor.com
Shameless plug for MomentsOfLight.com Moments of Light Logo