Importer: some bugs and ideas to improve data import from IPB 3.4.x

PolUser · December 26, 2015 at 2:13 PM

I have few things to report about Importer, when importing data from IPB 3.4.x into WBB

1. Quotes in IPB can be also in simple format:

Code

[quote name="some name"]some content[/quote]

Currently such quotation is not converted.

2. Something is wrong when converting formatting options, for example this (this is how it looks in database):

Code

<p><span style="color:rgb(28,40,55);font-family:arial, verdana, tahoma, sans-serif;font-size:13px;background-color:rgb(250,251,252);">content</span></p>

is converted to this (and does not work, it is showed as text):

Code

[color=rgb(28,40,55);font-family:arial, verdana, tahoma, sans-serif;font-size:13px;background-color:rgb(250,251,252)]content[/color]

This is happening both in post content and signatures. Probably this situation can exist if user in IPB pasted post content from other website/place without cleaning formatting options, so IPB saved his port with that formatting.

3. Some links are surrounded with:

Code

<!-- l -->
or
<!-- m -->

(in IPB database there are also such surroundings in some links, but they are invisible in thread view, don't know from where they came from)

4. In signatures:

Code

[size=2]content[/size]

was converted to:

Code

[size=36]content[/size]

which resulted gigantic signatures for some users after conversion. I saw that sometimes in IPB database there are signatures with:

Code

[size=NaN]content[/size]

which are converted to size=36 as well.

5. If in board name chars "<" or ">" are present, they are replaced to:

Code

> or <

6. Looks like warnings are not imported at all (?)

PolUser · December 26, 2015 at 9:45 PM

Update to 2:

Looks like this is something more complicated.

Post in IPB database:

Code

<div style="margin:0px;color:rgb(0,0,0);font-family:'Segoe UI', Tahoma, Verdana, sans-serif;font-size:8px;">
<p style="text-align:center;font-size:6pt;background-color:transparent;"><img src="http://s3.postimg.org/6eggfnb4z/000_mpg_snapshot_24_35_2015_09_30_08_50_31.jpg" alt="000_mpg_snapshot_24_35_2015_09_30_08_50_"></p>
<p style="text-align:center;font-size:6pt;background-color:transparent;"> </p>
<p style="text-align:center;font-size:6pt;background-color:transparent;"><span style="margin:0px;font-style:italic;font-size:11pt;font-family:Tahoma, sans-serif;background-color:transparent;">ROCK YOUR BABY</span><span style="margin:0px;font-size:11pt;font-family:Tahoma, sans-serif;background-color:transparent;">, </span><span style="margin:0px;font-weight:bold;font-size:11pt;font-family:Tahoma, sans-serif;background-color:transparent;">VH 1</span><span style="margin:0px;font-size:11pt;font-family:Tahoma, sans-serif;background-color:transparent;">, 27/11/2015</span><span style="margin:0px;font-size:11pt;font-family:Tahoma, sans-serif;background-color:transparent;"> </span></p>
<p style="text-align:center;font-size:6pt;background-color:transparent;"><span style="margin:0px;font-size:11pt;font-family:Tahoma, sans-serif;background-color:transparent;"><span style="margin:0px;background-color:inherit;">FAUL & WAD AD & PNAU – </span><span style="margin:0px;background-color:inherit;">Changes</span></span><span style="margin:0px;font-size:11pt;font-family:Tahoma, sans-serif;background-color:transparent;"> </span></p>
</div>
<div style="margin:0px;color:rgb(0,0,0);font-family:'Segoe UI', Tahoma, Verdana, sans-serif;font-size:8px;">
<p style="text-align:center;font-size:6pt;background-color:transparent;"><span style="margin:0px;font-size:11pt;font-family:Tahoma, sans-serif;"><span style="margin:0px;background-color:inherit;">ELTON JOHN – </span><span style="margin:0px;background-color:inherit;">Can</span><span style="margin:0px;background-color:inherit;"> </span><span style="margin:0px;background-color:inherit;">You</span><span style="margin:0px;background-color:inherit;"> </span><span style="margin:0px;background-color:inherit;">Feel</span><span style="margin:0px;background-color:inherit;"> The Love </span><span style="margin:0px;background-color:inherit;">Tonight</span></span><span style="margin:0px;font-size:11pt;font-family:Tahoma, sans-serif;"> </span></p>
</div>
<div style="margin:0px;color:rgb(0,0,0);font-family:'Segoe UI', Tahoma, Verdana, sans-serif;font-size:8px;">
<p style="text-align:center;font-size:6pt;background-color:transparent;"><span style="margin:0px;font-size:11pt;font-family:Tahoma, sans-serif;"><span style="margin:0px;background-color:inherit;">MIKA – </span><span style="margin:0px;background-color:inherit;">Relax</span><span style="margin:0px;background-color:inherit;"> (Take It </span><span style="margin:0px;background-color:inherit;">Easy</span><span style="margin:0px;background-color:inherit;">)</span></span><span style="margin:0px;font-size:11pt;font-family:Tahoma, sans-serif;"> </span></p>
</div>
<div style="margin:0px;color:rgb(0,0,0);font-family:'Segoe UI', Tahoma, Verdana, sans-serif;font-size:8px;">
<p style="text-align:center;font-size:6pt;background-color:transparent;"><span style="margin:0px;font-size:11pt;font-family:Tahoma, sans-serif;">HARDWELL FEAT. CHRIS YOUNG – Young </span><span style="margin:0px;font-size:11pt;font-family:Tahoma, sans-serif;"><span style="margin:0px;background-color:inherit;">Again</span></span><span style="margin:0px;font-size:11pt;font-family:Tahoma, sans-serif;"> </span></p>
</div>
<div style="margin:0px;color:rgb(0,0,0);font-family:'Segoe UI', Tahoma, Verdana, sans-serif;font-size:8px;">
<p style="text-align:center;font-size:6pt;background-color:transparent;"><span style="margin:0px;font-size:11pt;font-family:Tahoma, sans-serif;"><span style="margin:0px;background-color:inherit;">SPICE GIRLS – </span><span style="margin:0px;background-color:inherit;">Viva</span><span style="margin:0px;background-color:inherit;"> </span><span style="margin:0px;background-color:inherit;">Forever</span></span><span style="margin:0px;font-size:11pt;font-family:Tahoma, sans-serif;"> </span></p>
</div>
<div style="margin:0px;color:rgb(0,0,0);font-family:'Segoe UI', Tahoma, Verdana, sans-serif;font-size:8px;">
<p style="text-align:center;font-size:6pt;background-color:transparent;"><span style="margin:0px;font-size:11pt;font-family:Tahoma, sans-serif;"><span style="margin:0px;background-color:inherit;">SMASH MOUTH – </span><span style="margin:0px;background-color:inherit;">I'm</span><span style="margin:0px;background-color:inherit;"> A </span><span style="margin:0px;background-color:inherit;">Believer</span></span><span style="margin:0px;font-size:11pt;font-family:Tahoma, sans-serif;"> </span></p>
</div>
<div style="margin:0px;color:rgb(0,0,0);font-family:'Segoe UI', Tahoma, Verdana, sans-serif;font-size:8px;">
<p style="text-align:center;font-size:6pt;background-color:transparent;"><span style="margin:0px;font-size:11pt;font-family:Tahoma, sans-serif;"><span style="margin:0px;background-color:inherit;">GIGI D'AGOSTINO – Bla </span><span style="margin:0px;background-color:inherit;">Bla</span><span style="margin:0px;background-color:inherit;"> </span><span style="margin:0px;background-color:inherit;">Bla</span></span><span style="margin:0px;font-size:11pt;font-family:Tahoma, sans-serif;"> </span></p>
</div>
<div style="margin:0px;color:rgb(0,0,0);font-family:'Segoe UI', Tahoma, Verdana, sans-serif;font-size:8px;">
<p style="text-align:center;font-size:6pt;background-color:transparent;"><span style="margin:0px;font-size:11pt;font-family:Tahoma, sans-serif;"><span style="margin:0px;background-color:inherit;">RED HOT CHILI PEPPERS – </span><span style="margin:0px;background-color:inherit;">Californication</span></span><span style="margin:0px;font-size:11pt;font-family:Tahoma, sans-serif;"> </span></p>
</div>
<div style="margin:0px;color:rgb(0,0,0);font-family:'Segoe UI', Tahoma, Verdana, sans-serif;font-size:8px;">
<p style="text-align:center;font-size:6pt;background-color:transparent;"><span style="margin:0px;font-size:11pt;font-family:Tahoma, sans-serif;"><span style="margin:0px;background-color:inherit;">GNARLS BARKLEY – </span><span style="margin:0px;background-color:inherit;">Crazy</span></span><span style="margin:0px;font-size:11pt;font-family:Tahoma, sans-serif;"> </span></p>
</div>
<div style="margin:0px;color:rgb(0,0,0);font-family:'Segoe UI', Tahoma, Verdana, sans-serif;font-size:8px;">
<p style="text-align:center;font-size:6pt;background-color:transparent;"><span style="margin:0px;font-size:11pt;font-family:Tahoma, sans-serif;">MINI DISCO – Kaczuszki</span><span style="margin:0px;font-size:11pt;font-family:Tahoma, sans-serif;"> </span></p>
</div>
<div style="margin:0px;color:rgb(0,0,0);font-family:'Segoe UI', Tahoma, Verdana, sans-serif;font-size:8px;">
<p style="text-align:center;font-size:6pt;background-color:transparent;"><span style="margin:0px;font-size:11pt;font-family:Tahoma, sans-serif;">AQUA – Barbie Girl</span><span style="margin:0px;font-size:11pt;font-family:Tahoma, sans-serif;"> </span></p>
</div>
<div style="margin:0px;color:rgb(0,0,0);font-family:'Segoe UI', Tahoma, Verdana, sans-serif;font-size:8px;">
<p style="text-align:center;font-size:6pt;background-color:transparent;"><span style="margin:0px;font-size:11pt;font-family:Tahoma, sans-serif;"><span style="margin:0px;background-color:inherit;">OUTKAST – Hey </span><span style="margin:0px;background-color:inherit;">Ya</span></span></p>
<p style="text-align:center;font-size:6pt;background-color:transparent;"><span style="margin:0px;font-size:11pt;font-family:Tahoma, sans-serif;"><span style="margin:0px;background-color:inherit;">CRAZY FROG </span></span><span style="font-family:Tahoma, sans-serif;font-size:14.6667px;">– Daddy DJ</span></p>
<p style="text-align:center;font-size:6pt;background-color:transparent;"><span style="margin:0px;font-family:Tahoma, sans-serif;font-size:14.6667px;background-color:inherit;">SCHNAPPI – </span><span style="margin:0px;font-family:Tahoma, sans-serif;font-size:14.6667px;background-color:inherit;">Schnappi</span><span style="margin:0px;font-family:Tahoma, sans-serif;font-size:14.6667px;background-color:inherit;"> Das </span><span style="margin:0px;font-family:Tahoma, sans-serif;font-size:14.6667px;background-color:inherit;">Kleine</span><span style="margin:0px;font-family:Tahoma, sans-serif;font-size:14.6667px;background-color:inherit;"> </span><span style="margin:0px;font-family:Tahoma, sans-serif;font-size:14.6667px;background-color:inherit;">Krokodil</span></p>
</div><br /><p style="color:rgb(40,40,40);font-family:helvetica, arial, sans-serif;"><span style="font-family:arial, helvetica, sans-serif;"><span style="font-size:11pt;">==================================</span></span><span style="font-family:arial, helvetica, sans-serif;"><span style="font-size:11pt;">=======</span></span></p>
<p><span style="font-size:11pt;">Już w ten weekend VH1 </span><span style="font-size:14.6667px;">zaprezentuje</span><span style="font-size:11pt;"> widzom szkołę rocka, czyli zestawienie najbardziej rockowych hitów i nie tylko. Premiera dzisiaj o 20:00, powtórki jutro i w niedzielę o 21:00. Dodatkowo, chwilę po nadaniu w MTV, ujrzymy </span><span style="font-size:14.6667px;">powtórkę</span><span style="font-size:11pt;"> koncertu Placebo w ramach MTV Unplugged. Emisja także dziś, ale o godz. 22:00. Wszystkie wyniki w przyszłym tygodniu.</span></p>

Display More

was converted to:

Code

<div style="margin:0px;color:rgb(0,0,0);font-family:'Segoe UI', Tahoma, Verdana, sans-serif;font-size:8px;">
<p style="text-align:center;font-size:6pt;background-color:transparent;">[img]http://s3.postimg.org/6eggfnb4z/000_mpg_snapshot_24_35_2015_09_30_08_50_31.jpg[/img]
<p style="text-align:center;font-size:6pt;background-color:transparent;" >
<p style="text-align:center;font-size:6pt;background-color:transparent;">ROCK YOUR BABY, VH 1, 27/11/2015
<p style="text-align:center;font-size:6pt;background-color:transparent;">FAUL & WAD AD & PNAU – Changes




<div style="margin:0px;color:rgb(0,0,0);font-family:'Segoe UI', Tahoma, Verdana, sans-serif;font-size:8px;">
<p style="text-align:center;font-size:6pt;background-color:transparent;">ELTON JOHN – Can You Feel The Love Tonight




<div style="margin:0px;color:rgb(0,0,0);font-family:'Segoe UI', Tahoma, Verdana, sans-serif;font-size:8px;">
<p style="text-align:center;font-size:6pt;background-color:transparent;">MIKA – Relax (Take It Easy)




<div style="margin:0px;color:rgb(0,0,0);font-family:'Segoe UI', Tahoma, Verdana, sans-serif;font-size:8px;">
<p style="text-align:center;font-size:6pt;background-color:transparent;">HARDWELL FEAT. CHRIS YOUNG – Young Again




<div style="margin:0px;color:rgb(0,0,0);font-family:'Segoe UI', Tahoma, Verdana, sans-serif;font-size:8px;">
<p style="text-align:center;font-size:6pt;background-color:transparent;">SPICE GIRLS – Viva Forever




<div style="margin:0px;color:rgb(0,0,0);font-family:'Segoe UI', Tahoma, Verdana, sans-serif;font-size:8px;">
<p style="text-align:center;font-size:6pt;background-color:transparent;">SMASH MOUTH – I'm A Believer




<div style="margin:0px;color:rgb(0,0,0);font-family:'Segoe UI', Tahoma, Verdana, sans-serif;font-size:8px;">
<p style="text-align:center;font-size:6pt;background-color:transparent;">GIGI D'AGOSTINO – Bla Bla Bla




<div style="margin:0px;color:rgb(0,0,0);font-family:'Segoe UI', Tahoma, Verdana, sans-serif;font-size:8px;">
<p style="text-align:center;font-size:6pt;background-color:transparent;">RED HOT CHILI PEPPERS – Californication




<div style="margin:0px;color:rgb(0,0,0);font-family:'Segoe UI', Tahoma, Verdana, sans-serif;font-size:8px;">
<p style="text-align:center;font-size:6pt;background-color:transparent;">GNARLS BARKLEY – Crazy




<div style="margin:0px;color:rgb(0,0,0);font-family:'Segoe UI', Tahoma, Verdana, sans-serif;font-size:8px;">
<p style="text-align:center;font-size:6pt;background-color:transparent;">MINI DISCO – Kaczuszki




<div style="margin:0px;color:rgb(0,0,0);font-family:'Segoe UI', Tahoma, Verdana, sans-serif;font-size:8px;">
<p style="text-align:center;font-size:6pt;background-color:transparent;">AQUA – Barbie Girl




<div style="margin:0px;color:rgb(0,0,0);font-family:'Segoe UI', Tahoma, Verdana, sans-serif;font-size:8px;">
<p style="text-align:center;font-size:6pt;background-color:transparent;">OUTKAST – Hey Ya
<p style="text-align:center;font-size:6pt;background-color:transparent;">CRAZY FROG [font='Tahoma, sans-seriffont-size:14.6667px']– Daddy DJ[/font]
<p style="text-align:center;font-size:6pt;background-color:transparent;">SCHNAPPI – Schnappi Das Kleine Krokodil




<p style="color:rgb(40,40,40);font-family:helvetica, arial, sans-serif;">[font='arial, helvetica, sans-serif']==================================[/font][font='arial, helvetica, sans-serif']=======[/font]
Już w ten weekend VH1 zaprezentuje widzom szkołę rocka, czyli zestawienie najbardziej rockowych hitów i nie tylko. Premiera dzisiaj o 20:00, powtórki jutro i w niedzielę o 21:00. Dodatkowo, chwilę po nadaniu w MTV, ujrzymy powtórkę koncertu Placebo w ramach MTV Unplugged. Emisja także dziś, ale o godz. 22:00. Wszystkie wyniki w przyszłym tygodniu.

Display More

Because HTML is disabled by default - post is showed with visible HTML code. I'm not sure is it bug, because HTML tags are preserved, but this would lead to need to manually turn on HTML for some particular posts...

PolUser · December 28, 2015 at 3:12 AM

One more, sorry for that, but I'm still evaluating data after conversion

Looks like in pools titles some chars are as HTML entities, eg. " is as & quot; (of course without space )

PolUser · December 29, 2015 at 5:20 AM

Please don't kill me - I got one more

When importing additional profile fields - language strings are added only to default board language, not for all languages, which give result in names for other languages "wcf.user.option.option30" etc.

Importer: some bugs and ideas to improve data import from IPB 3.4.x

Participate now!

Tags