Upgrading to phpBB 3.x -- feedback needed

This is an archive of a topic from NESdev BBS, taken in mid-October 2019 before a server upgrade.
View original topic
Upgrading to phpBB 3.x -- feedback needed
by on (#87728)
First and foremost: no, the forum isn't going to be upgraded unless folks (as a majority) are cool with it.

Today I poked around with "migrating" the board to phpBB 3.0.9. I did install it (but not at the /bbs/ URL), and even converted/imported all the existing forum posts into the new board version. It worked, with only a couple errors (purely caused by old spammer posts). Quite honestly I was impressed by the conversion; I really didn't think it'd work.

There were a few oddities, such as <br> tags in some of the forum descriptions, and some other extremely minor stuff which I'm sure tepples and I could figure out. I didn't test UTF-8 post support, but our existing UTF-8 posts looked correct.

The newer software has some pretty decent/advanced anti-spam support, which I imagine would make a lot of people here happy. However, folks reading this paragraph need to remember that a *lot* of the spam we get here is a result of humans -- literally Indians or Chinese creating accounts manually, not via software. Captcha and captcha-equivalents can't solve that (but phpBB 3.x does support both kinds).

Anyway -- the biggest problem I ran into was that the existing nesdev forum style (black background, orange cells/bars, etc.) wasn't migrated. I tried to figure out how to manually create a new style (e.g. migrating it by hand), but was thwarted. It seems the style stuff between 2.x and 3.x is significantly different, and that's understandable. I have no problem spending the time to figure out how to get the existing nesdev forum style working in phpBB 3.x though (I tend to like dark backgrounds :-) ).

Though, so far I'm not impressed with phpBB 3.x's style support -- for one, it prefers to store the CSS in the back-end database rather than as a file on the filesystem (someone obviously doesn't understand the performance implications of this, sigh), but it does offer the ability.

All that said:

How would folks feel about migrating to newer software? Performance-wise it would be a big improvement, and from an administrative perspective it would be easier for me to manage (especially when dealing with spammers -- right now finding the IP of a spammer who creates an account but doesn't post anything is a serious pain in the ass).

Alternately there's the possibility of upgrading the board from 2.0.21 to 2.0.23 -- which I tried as well, and it did not turn out well. In fact, some of the PHP files for this forum are missing massive amounts of code (literally 40-50 lines in some files) for reasons I can't figure out, so I'm a little wary of going that route. I guess I could install 2.0.23 fresh then import all the forum posts to that.

Please discuss/provide feedback if you could. Thanks everyone!

by on (#87729)
I would like to see it updated to phpBB3, don't have much more to say. Just doesn't seem like there would be any downsides.

by on (#87732)
Since it makes things easier on you, if no posts are lost (seems they won't be) I'm cool with it as well.

by on (#87735)
Updates are usually good, I'm all for it.
Re: Upgrading to phpBB 3.x -- feedback needed
by on (#87739)
koitsu wrote:
Though, so far I'm not impressed with phpBB 3.x's style support -- for one, it prefers to store the CSS in the back-end database rather than as a file on the filesystem (someone obviously doesn't understand the performance implications of this, sigh), but it does offer the ability.

MediaWiki lets logged-in users edit their own CSS (e.g. User:Tepples/monobook.css), but Wikipedia doesn't have a performance problem. What's the underlying difference between a "file system" and a "database" anyway? They're both ways to store a collection of records.

Quote:
How would folks feel about migrating to newer software?

Go ahead.

Quote:
and from an administrative perspective it would be easier for me to manage

The permissions are slightly finer-grained too. phpBB 3 introduces a user level higher than moderator and lower than administrator called "global moderator" that can ban but can't do some other things that admins can do.

Quote:
I guess I could install 2.0.23 fresh then import all the forum posts to that.

If you're going to that trouble, you might as well go to 3 because at least 3 is still supported with security updates.
Re: Upgrading to phpBB 3.x -- feedback needed
by on (#87757)
tepples wrote:
koitsu wrote:
Though, so far I'm not impressed with phpBB 3.x's style support -- for one, it prefers to store the CSS in the back-end database rather than as a file on the filesystem (someone obviously doesn't understand the performance implications of this, sigh), but it does offer the ability.

MediaWiki lets logged-in users edit their own CSS (e.g. User:Tepples/monobook.css), but Wikipedia doesn't have a performance problem. What's the underlying difference between a "file system" and a "database" anyway? They're both ways to store a collection of records.


The underlying difference is that you can't use <link rel="stylesheet" type="text/css" href="some/file.css" /> when the CSS is stored in a database.

Instead, it all has to be done in-line (e.g. <style type="text/css">...</style>), which is a waste of network traffic and resources on every single fetch that would return that content, rather than letting the user's web browser download some/file.css once and refer to it from the local browser's cache. (Changes to the file are automatically handled given HTTP's caching semantics, things like ETag, etc. all help this work reliably -- this obviously can't happen with in-line CSS)

And it's an even bigger waste of resources if the software, on an HTTP fetch, pulls the CSS from the database, sticks it in a temporary file on the filesystem, and then uses <link> to refer to that -- removing the file when it's done -- this also defeats the benefits of caching. I've seen software out there do this and it baffles the mind; just another example of the horribly broken "shove EVERYTHING in a database" mentality.
Re: Upgrading to phpBB 3.x -- feedback needed
by on (#87763)
koitsu wrote:
The underlying difference is that you can't use <link rel="stylesheet" type="text/css" href="some/file.css" /> when the CSS is stored in a database.

Instead, it all has to be done in-line (e.g. <style type="text/css">...</style>)

<link rel="stylesheet" type="text/css" href="some/style_script.php?theme=prosilver" />
and then style_script.php would calculate an ETag (based on last-modified date? SHA-1?) and other cache-related headers and spit out the style sheet.

by on (#87769)
Go ahead. The style should be able to be figured out with time. I'm sure we can live with a different style for the transition phase.

by on (#87771)
How exactly do you stop Indian spammers anyway, besides blocking all IPs from India?

by on (#87775)
Dwedit wrote:
How exactly do you stop Indian spammers anyway, besides blocking all IPs from India?


Given that they read English and *absolutely* read the forum posts, I'll discuss this with you privately. :-)
Re: Upgrading to phpBB 3.x -- feedback needed
by on (#87776)
tepples wrote:
koitsu wrote:
The underlying difference is that you can't use <link rel="stylesheet" type="text/css" href="some/file.css" /> when the CSS is stored in a database.

Instead, it all has to be done in-line (e.g. <style type="text/css">...</style>)

<link rel="stylesheet" type="text/css" href="some/style_script.php?theme=prosilver" />
and then style_script.php would calculate an ETag (based on last-modified date? SHA-1?) and other cache-related headers and spit out the style sheet.


It's too bad it isn't done this way. That's a lot of work for something the webserver already does itself with flat files anyway... :-(

by on (#87777)
We should have NES-related questions during the subscription process.
Re: Upgrading to phpBB 3.x -- feedback needed
by on (#87793)
koitsu wrote:
tepples wrote:
<link rel="stylesheet" type="text/css" href="some/style_script.php?theme=prosilver" />
and then style_script.php would ca

It's too bad it isn't done this way.

It is in MediaWiki. (See http://wiki.nesdev.com/w/index.php?title=-&action=raw&gen=css.) Or does the architecture of phpBB 3 preclude this?

Quote:
That's a lot of work for something the webserver already does itself with flat files anyway... :-(

Three differences:
  1. Again, what's the fundamental difference between a "flat file" and a "blob", or between a "file system" and a "database"? A file system is like a database in that the filename is a key and the data in a file is a value.
  2. The web server doesn't know how to handle authentication and authorization to determine whether a particular user logged in through the phpBB session system is allowed to see a given flat file. That's why MediaWiki uses a PHP wrapper for images on private wikis.
  3. I think under some kinds of security policies implemented on web servers, which are analogous to W^X policies within a process, PHP scripts within the web root don't have the privileges to write to directories within the web root. Any dynamic content has to be either database-driven or changed through a separate CGI directory.

by on (#87807)
Sounds good to me, but do as you please Koitsu. :D

by on (#87811)
Upgrade sounds good to me. If we can somehow keep the same color scheme that would be great though, so people know where they are. Nothing is more bland that having 90% of the forums around using the same default color scheme (even though "our" color scheme was the default of a different forum software, heh).

by on (#87813)
I vote we fix the images though... all images here have anti-aliasing for light backgrounds, which looks really silly on our dark backgrounds.

by on (#87814)
I don't know why I never noticed that, but now I can't unsee it.

by on (#87816)
I'm still using Punbb (old version before the fork), because it's so easy to edit the php code to get it to do stuff differently.