BOB: Business Objects Board
Not endorsed by or affiliated with SAP

Register | Login 

Sunset Ride 
Sunset Ride 

General Notice: BOB is going to retire...please see details here. All BOB forums have been converted to "read only" as of September 1st.
General Notice: No events within the next 45 days.

BOB 2.0
2 members found this topic helpful
Goto page Previous  1, 2, 3, 4, 5, 6, 7, 8  Next
 
Search this topic... | Search About BOB... | Search Box
Register or Login to Post    Forum Index -> About BOB  Previous TopicPrint TopicNext Topic
Author Message
kbrazell
Principal Member
Principal Member



Joined: 19 Aug 2003

Posts: 206
Location: DFW Metroplex (but mobile) I applied to Mars One


flag
PostPosted: Tue Sep 08, 2020 1:42 pm 
Post subject: Re: BOB 2.0

julienbras wrote:
I think we can go for a org other a com extension as we want to more have an organization (non-profit) than a commercial one.


bobj-board.org FTW

I too vote for the ORG designation.

_________________
Kyle Brazell
General Contractor
BI Developer.....................BOBJ XIr3, on Oracle 8, 8i, 10g, 11g, with HP-UX, AIX, Linux
IoT Developer
Web Developer
Embedded System Programmer
Back to top
julienbras
Principal Member
Principal Member



Joined: 25 Jul 2007

Posts: 127
Location: Montreal, QC


flag
PostPosted: Tue Sep 08, 2020 8:38 pm 
Post subject: Re: BOB 2.0

substring wrote:
A little late to the party, but I have just voted to keep the name. icon_smile.gif


Not an option anymore icon_wink.gif It must be a new domain name, see previous posts,

_________________

Julien Bras -- Product Manager @ GB&Smith --- latest articles:
• 2020-05-03 Moving from Eclipse to VSCode by a Java Developer
• 2019-12-04 Temp acceptance systems on AWS
• 2018-09-30 Web Scrapping with Python
Back to top
Dave Rathbun
Forum Advocate
Forum Advocate



Joined: 06 Jun 2002

speaker.gif*16
Posts: 22107
Location: Dallas, Texas


flag
PostPosted: Wed Sep 09, 2020 3:49 pm 
Post subject: Re: BOB 2.0

kbrazell wrote:
bobj-board.org FTW

I like it!

_________________
Dave's Adventures in Business Intelligence Image link

Latest Blog Posts
• 2019-09-19 Stephen Few Blog Post on Multivariate Visualization
• 2019-02-11 Update on Query Banding
• 2018-10-19 BI Evolution
Back to top
julienbras
Principal Member
Principal Member



Joined: 25 Jul 2007

Posts: 127
Location: Montreal, QC


flag
PostPosted: Thu Sep 10, 2020 6:42 am 
Post subject: Re: BOB 2.0

Dave Rathbun wrote:
I like it!


approved by BOB father icon_smile.gif

I have just registered for bobj-board.org, I will migrate existing test server to the correct dns today or tomorrow !

UPDATE:

we are live on https://bobj-board.org/ !

_________________

Julien Bras -- Product Manager @ GB&Smith --- latest articles:
• 2020-05-03 Moving from Eclipse to VSCode by a Java Developer
• 2019-12-04 Temp acceptance systems on AWS
• 2018-09-30 Web Scrapping with Python
Back to top
Dave Rathbun
Forum Advocate
Forum Advocate



Joined: 06 Jun 2002

speaker.gif*16
Posts: 22107
Location: Dallas, Texas


flag
PostPosted: Fri Sep 11, 2020 11:15 am 
Post subject: Re: BOB 2.0

When do you want me to send you a copy of the post data?

I have cleaned out a number of the hidden forums so as to not end up sending you that unnecessary data. I have as mentioned earlier created a copy of the post table that has all of the adjustments made. I think I would like to get the copy to you earlier rather than later so there is a few weeks (or months) of parallel existence.

Actually this might be a good time to ask which of the tables I sent from the BOB Beta site you are actually importing? There are quite a few tables that are probably not necessary for what you are doing.

For example, you will want the _ATTACHMENTS and _ATTACHMENTS_DESC tables to know the filename to attach to which post, but you won't need _ATTACH_QUOTA or _ATTACHMENTS_CONFIG as those aren't relevant to your platform.

_________________
Dave's Adventures in Business Intelligence Image link

Latest Blog Posts
• 2019-09-19 Stephen Few Blog Post on Multivariate Visualization
• 2019-02-11 Update on Query Banding
• 2018-10-19 BI Evolution
Back to top
julienbras
Principal Member
Principal Member



Joined: 25 Jul 2007

Posts: 127
Location: Montreal, QC


flag
PostPosted: Fri Sep 11, 2020 11:35 am 
Post subject: Re: BOB 2.0

Hello Dave,

The earliest the best as it is better to avoid having 2 platforms for a long time as you say,

Currently the script is using the following tables as previously mentioned:

Quote:

Actually I am using the following tables from phpBB2 in my import script:
* busobj_users
* busobj_categories
* busobj_forums
* busobj_topics
* busobj_posts
* busobj_posts_text
* busobj_smilies (get info on custom emojis)
* busobj_attachments (contains attachments info)
* busobj_attachments_desc (contains attachments info)


I will just have to adapt for the minor change you have done on the _posts table.

Thanks !

_________________

Julien Bras -- Product Manager @ GB&Smith --- latest articles:
• 2020-05-03 Moving from Eclipse to VSCode by a Java Developer
• 2019-12-04 Temp acceptance systems on AWS
• 2018-09-30 Web Scrapping with Python
Back to top
Dave Rathbun
Forum Advocate
Forum Advocate



Joined: 06 Jun 2002

speaker.gif*16
Posts: 22107
Location: Dallas, Texas


flag
PostPosted: Fri Sep 11, 2020 12:06 pm 
Post subject: Re: BOB 2.0

I think I had all of those except the categories table in an email that I just sent you. I will work on getting that data to you now.
_________________
Dave's Adventures in Business Intelligence Image link

Latest Blog Posts
• 2019-09-19 Stephen Few Blog Post on Multivariate Visualization
• 2019-02-11 Update on Query Banding
• 2018-10-19 BI Evolution
Back to top
Dave Rathbun
Forum Advocate
Forum Advocate



Joined: 06 Jun 2002

speaker.gif*16
Posts: 22107
Location: Dallas, Texas


flag
PostPosted: Fri Sep 11, 2020 12:58 pm 
Post subject: Re: BOB 2.0

Julien, sent another email that includes a link to download a zip of the flag images as well as a zip of the database export after the updates.
_________________
Dave's Adventures in Business Intelligence Image link

Latest Blog Posts
• 2019-09-19 Stephen Few Blog Post on Multivariate Visualization
• 2019-02-11 Update on Query Banding
• 2018-10-19 BI Evolution
Back to top
julienbras
Principal Member
Principal Member



Joined: 25 Jul 2007

Posts: 127
Location: Montreal, QC


flag
PostPosted: Sat Sep 12, 2020 4:36 pm 
Post subject: Re: BOB 2.0

Dave, some updates :

* it is not the same to load 300 rows or 900k rows icon_biggrin.gif the utility pgloader need to be well setup to work as intended icon_wink.gif
* I have converted the data to a pg database
* I am now testing / adapting my migration script

[UPDATE 2]
* I have changed the script in order to keep original ids, it speed up a lot the extraction (but not able to keep content already created on new forum)
* I plan to push that the prod today if all is good !

Thanks !

Will keep you updated,

_________________

Julien Bras -- Product Manager @ GB&Smith --- latest articles:
• 2020-05-03 Moving from Eclipse to VSCode by a Java Developer
• 2019-12-04 Temp acceptance systems on AWS
• 2018-09-30 Web Scrapping with Python
Back to top
Dave Rathbun
Forum Advocate
Forum Advocate



Joined: 06 Jun 2002

speaker.gif*16
Posts: 22107
Location: Dallas, Texas


flag
PostPosted: Mon Sep 14, 2020 1:47 pm 
Post subject: Re: BOB 2.0

Good progress note, thanks!

When you are ready to turn things on, what I plan to do is replace BOB with a note about the community move and a link to your new resource.

_________________
Dave's Adventures in Business Intelligence Image link

Latest Blog Posts
• 2019-09-19 Stephen Few Blog Post on Multivariate Visualization
• 2019-02-11 Update on Query Banding
• 2018-10-19 BI Evolution
Back to top
julienbras
Principal Member
Principal Member



Joined: 25 Jul 2007

Posts: 127
Location: Montreal, QC


flag
PostPosted: Mon Sep 14, 2020 3:24 pm 
Post subject: Re: BOB 2.0

Running well !

Data have been pushed on discourse, I am running post import process (like markdown / bbcode conversion to html) and it take TIME (currently at 32.9% started this morning !)

[UPDATE]
* The conversion process is done (I have switch to a more powerful azure instance for this task...)
* I still have a big queue of task to do in sidekiq (the async system of discourse), like 1,000,000 tasks to do (linked to the the conversion process just done)
* I have to run an other task to re-order posts based on date (it fail currently), I will retry when the queue will be empty.

So I need YOU community to browse on https://bobj-board.org and check if all seems ok for you. Just note that I still need to re-order posts !

Thanks for your valuable feedbacks !

_________________

Julien Bras -- Product Manager @ GB&Smith --- latest articles:
• 2020-05-03 Moving from Eclipse to VSCode by a Java Developer
• 2019-12-04 Temp acceptance systems on AWS
• 2018-09-30 Web Scrapping with Python
Back to top
julienbras
Principal Member
Principal Member



Joined: 25 Jul 2007

Posts: 127
Location: Montreal, QC


flag
PostPosted: Wed Sep 16, 2020 10:04 am 
Post subject: Re: BOB 2.0

News for today:
* the sidekiq queue is reducing slowly (still 580,000 tasks)
* the post order task is now completed
* i have dropped the attachments image ore ok
* still having issue on attachments other than image like here

Waiting for feedback from other testers too !

Do not hesitate to create a new account on the new platform (no account have been created unless 4 or 5 moderators)

_________________

Julien Bras -- Product Manager @ GB&Smith --- latest articles:
• 2020-05-03 Moving from Eclipse to VSCode by a Java Developer
• 2019-12-04 Temp acceptance systems on AWS
• 2018-09-30 Web Scrapping with Python
Back to top
JohnBClark
Forum Enthusiast
Forum Enthusiast



Joined: 27 Mar 2007
ASUG Icon
Posts: 1053
Location: Appleton, WI USA


flag
PostPosted: Wed Sep 16, 2020 10:28 am 
Post subject: Re: BOB 2.0

Looking good. It will take a while to get used to the functional changes. I did create an account there. Will I have to redo it again if you have to reload the PHP database?
_________________
BusinessObjects BI4.2sp8, SQL Server 2016 (CMS)
Clustered for fail over redundancy
Reporting Tools: Crystal Reports 2016sp4, Web Intelligence
Operating System: Windows 2016 running on VMWare
Reporting databases: SQL Server, Teradata, Oracle, Hive, Snowflake
Information Steward 4.2sp10
History: BO5, BO6, XIR2, XI3.1, BI4.1.x
Back to top
julienbras
Principal Member
Principal Member



Joined: 25 Jul 2007

Posts: 127
Location: Montreal, QC


flag
PostPosted: Wed Sep 16, 2020 10:36 am 
Post subject: Re: BOB 2.0

JohnBClark wrote:
Looking good. It will take a while to get used to the functional changes. I did create an account there. Will I have to redo it again if you have to reload the PHP database?


No, I will keep the user table. But i will try to avoid a full loading if possible, as there is some unwanted side effect (I have to recreate manually some mandatory topics like TOS, FAQ, etc), and we will have to probably modify the category organization to fit more Discourse (having more top level categories as only top level categories have a description, maybe switch the third level categories to tags...)

Thanks !

_________________

Julien Bras -- Product Manager @ GB&Smith --- latest articles:
• 2020-05-03 Moving from Eclipse to VSCode by a Java Developer
• 2019-12-04 Temp acceptance systems on AWS
• 2018-09-30 Web Scrapping with Python
Back to top
julienbras
Principal Member
Principal Member



Joined: 25 Jul 2007

Posts: 127
Location: Montreal, QC


flag
PostPosted: Wed Sep 16, 2020 9:59 pm 
Post subject: Re: BOB 2.0

Yes ! Here is the last updates on the migration:

* Public content have been migrated on bobj-board.org thanks to Dave for the extract icon_wink.gif
* Attachments have been migrated too (images and files) ; links are working!
* Each post from the import come with a small signature that include the username, the flag (if set in the profile) and the user creation date on BOB
* the longest part of the migration is a technical process that is named rebake on Discourse, it consist of generating the html content from a raw field (that can contains bbcode or markdown). It need to be done after import and it take at least 72h (I have set an instance with more memory for this part and started multiple Sidekiq process that help). Currently there is still a queue of 330k tasks (I assume that 60% of the 900k posts are already baked)

I know there is still some optimization that can be done:
* add an space before and after the flag in the signature
* probably some bbcode are not parsed correctly and need a fix
* some topic title show some encoded char as & [fixed this one]
* some emojis have not been migrated (the non-text ones)

Most of the optimization will require a rebake so again probably around 72h to be done on all posts.

Based on that I think there is 2 options :
* there is consensus to go on this solution + existing import and we can optimize it little by little
* there is NO consensus and the actual work on bobj-board.org is not 'validated' (either the software chosen or the import or both) > we need to work more

Actually I don't want to create topics on bobj-board.org if the import is not validated, as the import need to be done with an empty database (the script is keeping the ids from phpbb to have easy insert queries)

So let me know, I am waiting from some feedback ! icon_wink.gif

_________________

Julien Bras -- Product Manager @ GB&Smith --- latest articles:
• 2020-05-03 Moving from Eclipse to VSCode by a Java Developer
• 2019-12-04 Temp acceptance systems on AWS
• 2018-09-30 Web Scrapping with Python
Back to top
Display posts from previous:   
Register or Login to Post    Forum Index -> About BOB  Previous TopicPrint TopicNext Topic
Page 7 of 8 All times are GMT - 5 Hours
Goto page Previous  1, 2, 3, 4, 5, 6, 7, 8  Next
 
Jump to:  

Index | About | FAQ | RAG | Privacy | Search |  Register |  Login 

Not endorsed by or affiliated with SAP
Powered by phpBB © phpBB Group
Generated in 0.1000 seconds using 17 queries. (SQL 0.0034 Parse 0.0676 Other 0.0290)
CCBot/2.0 (https://commoncrawl.org/faq/)
Hosted by ForumTopics.com | Terms of Service
phpBB Customizations by the phpBBDoctor.com
Shameless plug for MomentsOfLight.com Moments of Light Logo