MysqlWeb Development

How To use Wordpress for Content Aggregation, 100,000 posts, MYSQL issues and Wordpress Performance Tuning revisited

More than a year ago I worked with Wordpress in a content-aggregator setup… this means we had about 20-100 new posts per day.

At that time I found a lot of really performance hog SQL queries in the wordpress installation 1.2 and later 1.5

to finish my follow up for the last years post – I got a wordpress installation with 100,000 posts to run by the following actions

  • I removed the date-related filters
  • I removed the reverse index accesses (which are not supported by MYSQL, thereby causing full table scans)
  • I removed all sorts of counts that were queried over and over again (no of posts per category)

Domas wrote about similar troubes and issues with the MYSQ queries

Quote:
I had inner voice inside (from the hosting business past) – but MySQL has query cache! Yes, it has, but putting timestamps into queries eliminates possibilities of caching. And one should not rely on query caching, one should rely on data and index caching. This is where databases shine.

Final question: Will upgrade to WordPress 2.0 solve these issues? Won’t I be trapped in yet another featuritis?

My initial feeling that wordpress was not written for content aggregation can be confirmed.

Some links to other performance issues with wordpress tell us a lot:

  • This guy looked at the MYSQL queries as well

  • five ways to improve WP Performance

  • using SpamKarma and other fancy plugins don't make performance issues better

    Generally the advice is to install the WP-Cache module, which allows static caching of wordpress blogs… I wonder how if affects all those inperformant reverse index lookups and such…

  • High Performance WP with WP-Cache – about the WP-Cache installation

  • WP Cache2 experiences

    However, today I revisit Wordpress 2.0 and wonder about improvements made on the performance side…

    I will try that WP-Cache 2 module and see how an out-of-the-box Wordpress 2.0 installation handles 100,000 entries in a blog :-) From the first look this module will help A LOT... we will see.

    Average rating
    (1 vote)
  • Similar entries

    • While testing WordPress for a news aggregation project I noticed that the slow-query log of MYSQL grew and grew… well… no wonder… brrr… temporay segments, and filesorts go to disk…

    • WordPress Subdomain Plugin

    • I received an abnormal high number of signals and messages from people abandoning their Wordpress blogs,

      because of their hacks, just like Fridaynite did .

      It appears to me that simply because there are so many vulnerable Wordpress installations out there, it became a promising goal

      to hack Wordpress installs and

      • inject some HTML code (for links)
      • inject WHOLE POSTS into the wordpress archives (backdated)

      • put in some cookie-stuffing code in to overwrite affiliate links’ credits

    • If your just want to step into the world of blogging and want to work a bit with the system "WordPress" (a pretty cool state-of-the art bloggin tool) , then go to Weblogs.us Beta Wordpress Signup for a test drive…...

    • Wordpress Geekwear is selling via Drupal ecommerce implementation… sometimes…