Plugin development and the fear of change

2255781557_d7148597a7_z

Yesterday I was taken off guard with a comment/concern from an anonymous WooCommerce developer named “Jonathan”. Jonathan was annoyed at upcoming changes in the core WC plugin:

Mike, one thing that strikes me about WC as compared to WP is stability of maintstay features and code structures. Notice that WP rarely breaks a site.

He went on to compare WordPress to WooCommerce:

This is something all the devs of WC should take careful note of. As a glaring example, WC 2.1 will break a lot of plugins. I know this to be fact our company has developed dozens upon dozens of custom plugins for WC for our customers.

Jonathan’s personal feeling was that plugins should avoid change. His main gripe was our ‘restructuring’ of core classes.

But it’s simply an ideological / philosophical tree structure decision that makes no difference in the overall operation of the software

Yes, we could have left them as they were and not much would change operationally. But the old structure was a mess and inflexible.

To explain a little, we had a classes folder, function files willy nilly, a separate admin folder with more classes inside etc. Anyone coming into WC development would see this and think “WTF are these jokers doing?”.

So yes, whilst we could have left them alone, we changed them – this will improve the plugin structure long-term, even if that means breaking some things short-term (note however: we didn’t envision this particular change could break anything).

I put the question to twitter:

There were some interesting replies, and the decision was unanimous from both plugin developers like Pippin, and freelancers like Sean; Improve and Change > Supporting legacy.

You can view the full conversation here if you wish: https://twitter.com/mikejolley/status/414837248572796928

WordPress isn’t perfect

Jonathan’s argument stemmed from the fact WordPress doesn’t break things often. But remember it still does.

Take MP6 for example; 3.8 changed the look and feel of WordPress admin, as a result styling in many plugins has been “broken”, including menu icons. Now, albeit not a site-breaking change, it means all < 3.8 plugins will need to make some visual alterations.

And what about the major updates 1.0 -> 2.0, 2.0 -> 3.0 – I’m certain plugins built for 2.0 would fail for 3.0, so why would WooCommerce 1.0 to 2.0 be any different? You shouldn’t expect your code to work forever.

Why changes are important

Whether they be features, refactors, or file structure changes, changes are important. Without making these decisions your plugin cannot evolve – you don’t want to be stuck with a v1.0 forever. It’s natural for things to crop up after the first release and after some real-world usage. Users will find bugs, oversights, or simply won’t be able to work with the plugin as they want to. Thats why you need to make the hard decisions for the greater good.

I can give you an example of a plugin-breaking change in WooCommerce. The order system in WooCommerce 1.0.x used post meta to store line items. This worked perfectly fine but with real-world usage it meant:

  • queries of line items were extremely heavy
  • serialisation of data was slow
  • the system was inflexible
  • a slight error in line item data would break all lines

So we created a custom table in 2.0 to store line items and the system is now way more stable. This change would have broken any plugin using those old meta fields directly, but it was necessary.

If you don’t improve, someone else will

You need to keep up to date with new features and enhancements. If you don’t someone else will, either with a fork or with a new competing plugin. Let us take an eCommmerce plugin example.

WordPress 3.0 “Thelonious Monk”, was released June 17, 2010 with the revolutionary new ‘custom post types’ feature.

Shopp, one of the biggest eCommerce plugins at the time, up to then was using its own custom tables and UI for products simply because no other core alternative was available.

It took 2 years for Shopp to support custom post types (Feb, 2012) and in that time countless new eCommerce plugins were released; WooCommerce, Jigoshop, eShop, Marketpress to name a few. Shopp had to lose many users over this, an example in their comments:

Too late for me. I wish you guys all the luck as you were there when I needed you years ago, but I’ve been seeing other shopping carts and they are getting all the future love.

See my point? I’m sure a large factor in this delay was the fear of change and backwards compatibility, but sometimes you’ve just got to say “screw it” and get the ball rolling before its too late.

What plugin developers should do

Keep backwards compatibility if possible

If its possible to keep backwards compatibility, even for a few releases, you should. Use deprecated functions, fallbacks, and output warnings. Production sites shouldn’t break and shouldn’t show these, but development sites will and developers will be able to get their customisations updated before the site falls over.

Only make major changes in major releases

Don’t make site-breaking changes in minor releases – that would would be irresponsible. If you have to change a fundamental part of your plugin, ensure its a major release with an obvious major version update.

Announce it

It’s no good changing something un-announced and watching the havoc unfold; notify your users.

Blog posts, dedicated development blogs, in-plugin warnings and notifications, an ‘upgrade notice’ in your readme – all good ways of notifying your users. As long as developers utilising your plugin are listening, they’ll be able to act accordingly.

What client developers should do

If you’ve built something for a client, or a product on top of a plugin, you are ultimately responsible for its functionality.

Listen

Stay up to date with plugin developments, listen to announcements and ensure major updates don’t crop up without you knowing first.

Plan for maintenance

Understand it won’t be a build once, ignore forever chunk of code. You will need to plan updates and maintenance into your proposal, otherwise your clients will be stuck with old versions. Charge more, as Brian so bluntly puts it:

You wouldn’t sell a car and then fix it for free for life, so when you sell a plugin don’t do the same. Create a plan to deal with updates and do them as required.

Test

Test your code with major updates before running them. If you need to do this on behalf of your client, ensure they are aware of these costs up front.

Follow best practice

If developers tell you how you should be doing something, follow their guidance. In Jonathan’s case he has been including core classes:

We probably have to modify about 40 of them, simply because you guys decide to move files around in the core tree and no other reason. This is seriously bad practice and really ought to stop now.

We’ve never recommended this practice, nor provided any code, snippet or plugin which does this and whilst I cannot comment on whether or not he was right to do what he did, but it doesn’t feel right. We always recommend using the many filters provided, but if they weren’t suitable this leads me to my next point.

If something is wrong, make your case before it is too late

If you spot a problem in the plugin you are developing for, perhaps one you cannot work around, let the developer know. Otherwise, how can they help you?

In the case of WooCommerce we have both a development blog and github issues setup – tell us, suggest an alternative, get involved. If you do nothing you only have yourself to blame.

Sorry Jonathan

I know updates can be frustrating and appreciate your situation, but we’re working towards building a better solution overall. If that means breaking some custom code along the way, I honestly believe it’s well worth it in the end.

Please don’t give up, and by all means get involved – thats the beauty of open source, anyone can contribute their ideas, code and guidance.

Thanks for reading.

Photo by stuant63, CC-BY-2.0


Posted

in

by

Comments

4 responses to “Plugin development and the fear of change”

  1. Chris Howard avatar

    I try not to say someone is wrong, but jonathon is. All I can suppose is he wasn’t around for wp 3.5. It was borderline disaster for many plugin and theme developers, Woo included.

    WP 3.5 had some major changes, particularly in the media library, and broke so many sites. Despite the best efforts f developers to have their stuff ready and compatible, it still caused havoc.

    It’s not like every release of WooCommerce is breaking plugins. As nor does WP.

    But occasionally a vendor does have to make major changes to their software. And if you develop add ons for that software, you’ll have to be as best prepared as possible.

    To be an add on developer the first thing you must accept is that you have to maintain compatibility with the software, whether that’s a WP or WooCommerce, not *them* maintaining compatibility with your add on.

  2. Brad Touesnard avatar

    Great article Mike. Have you guys considered giving people a longer window to upgrade by maintaining older versions of WooCommerce? For example, after the 2.1 release, announce that 2.0.x will continue to receive security updates until July 2014 and will then be retired. I think a lot of people would breathe a sigh of relief knowing that you guys are still on top of issues in 2.0.x and that they have a full 6 months to get their systems upgraded and tested for 2.1. A lot of open source projects do this already.

    1. mikejolley avatar
      mikejolley

      We’ve not given this much thought to be honest. Managing multiple versions isn’t ideal IMO; extra burden for plugin devs, support people, and us working on core.

      Thats not to say plugins for 2.0.x won’t work for 6 months though – deprecated notices won’t make or break a site (and should be hidden anyway).

  3. Brad Touesnard avatar

    Jonathan is clearly in the wrong here. Whenever you include a file from a project you don’t control, you should be doing it with the hope that it will never change. But if it does change, you shouldn’t be surprised.

    I think the risk of not maintaining backward compatibility really depends on the plugin. The stakes are higher when the plugin is widely used, highly extensible, often extended, and when it’s a mission critical piece. Like WordPress, WooCommerce is all of those things, so when changes come that break things, it’s a huge deal for a lot of people. You definitely need to strike a careful balance between innovating and maintaining backward compatibility. As you say, you risk falling behind otherwise. WordPress itself has been criticized recently for its slow innovation, pointing to Ghost as a result of that frustration.

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.