PDA

View Full Version : MapleStory Global's Content Testing



Combattente
2010-01-23, 07:10 AM
Description of Issue:
Global MapleStory's Public Test Server, Tespia, which was opened more than one year ago through an event in which you had to submit your application for a random selection to be chosen, was closed on July 2008 and since then it wasn't opened anymore. The reason of this is simple: it didn't work as intended and the official patches kept containing bugs. And it's bugs the major issue I want to talk about now. Global MapleStory lacks of thorough patch testing by NEXON's Staff, which results in patches introducing various bugs in the game every time.

Why this issue needs attention:
It's a matter of fact: each single content patch (excluding bug-fixing ones) brings more or less important bugs to MapleStory. It's also a matter of fact that NEXON workers don't have the time to browse each MapleStory forum to notice which bugs were added to the game and need to be fixed. Also, there is way too much spam in the "bug report" section of their forum, making it almost useless.
People almost always have to wait until the next patch to have most of the bugs fixed, unless they are major ones (in that case, an Emergency Patch is made).
All these bugs could easily be avoided if there was a thorough content testing of patches by the NEXON Staff. Apparently, this is not the case, and bugs of all kinds keep being introduced in the game with every patch.

Desired Action or Resolution:
The only solutions to this are two: more thorough testing by NEXON's testing staff (and possibly choosing tester staff which is really experienced with the game itself), which would undoubtedly help, or hosting another round of Public Content Testing. The ex-NEXON worker NxProse said that the reason of the closure of Tespia was the fact that many people abused of the report page and sent spam / useless messages, making it really hard for the development staff to identify the bugs. This problem could be easily resolved in many ways: one of them would be, obviously, making the page private and only viewable from testers, which wasn't implemented before, as everyone could see it and send reports.
A second way would be making the selections for Tespia more strict. This means making MWLB-like applications, and being almost as strict as choosing MWLB members. This way, no random people who don't have enough experience of the game itself will be able to get in, and there won't be so many false reports anymore. Also, put more and more restrictions, for example: 'having an account older than 2 years' or 'having a character over level 120'. Not everyone should be able to get in, as only people who have enough experience of the game will be able to test the new content correctly. Also, with the level 120 restriction, the chances of people using Tespia just to have an high-leveled character will be reduced. Another suggestion would be letting Cody level you up a certain number of times, based on the level of the new content which needs to be tested and not making him always give you 162 levels. This will also reduce the amount of people only using Tespia for personal purposes, and not for real testing.
Finally, hiring staff members who will read through all the reports and report them to the developers, who should possibly try to fix them before the actual patch in the official servers. Therefore, there should be a Content Testing round before every official patch, just like it was before Tespia was closed, and, as always, people who report the most legit bugs should be entered in the next round automatically, while people who didn't send any report or sent false ones should be restricted from joining Tespia again. This way, the Public Content Testing Server would most likely work, and the users wouldn't have to deal with such a large amount of bugs every patch (especially after big ones).
Whatever way NEXON Korea uses with Tespia.. they just succeed on making it a successful test server. NEXON America should do the same: just follow NEXON Korea's pattern, and Tespia should finally work as intended.

Lozmaster
2010-01-23, 11:13 AM
They stoped testing because they dont want to spend their money on another "client" i dare you to prove me wrong

Well, we know they do their own "testing" or the game would be much worse, and they occasionally let press members (or provide them with screenshots from it) for previews. They just don't let us near it anymore.

Eos
2010-01-24, 02:11 AM
They actually have a dedicated QA team who do content testing. That staff was also responsible for wading through the "reports" from Tespia.

You've seen the effectiveness. The real problem may be more about them having to ship things back to Wizet to actually be prioritized and worked on.
During the MWLB creation process I tried to push for the MWLB to also be included in Tespia as a more real-world-testing scenario but despite having been "added to the list of considerations" I don't believe anything ever came from it.

Bomber
2010-01-24, 08:42 PM
They actually have a dedicated QA team who do content testing. That staff was also responsible for wading through the "reports" from Tespia.

You've seen the effectiveness. The real problem may be more about them having to ship things back to Wizet to actually be prioritized and worked on.
During the MWLB creation process I tried to push for the MWLB to also be included in Tespia as a more real-world-testing scenario but despite having been "added to the list of considerations" I don't believe anything ever came from it.

I don't understand your point :X
What do you mean by, the affectiveness and team thing as compared to his post?here? (basically the first & second mini paragraphs)

Eos
2010-01-24, 08:47 PM
I don't understand your point :X
What do you mean by, the affectiveness and team thing as compared to his post?here? (basically the first & second mini paragraphs)

You have seen how effective their QA team is. Hiring yet more of them isn't going to make any difference.

Bomber
2010-01-24, 08:53 PM
You have seen how effective their QA team is. Hiring yet more of them isn't going to make any difference.

Basically, they are so unaffective, that hiring more people won't change the affectiveness of their content as bugging.
Hmmm, I give this support, but even after you guys tell me how to do this, I never get it right but....I'll try.

Shidoshi
2010-01-24, 09:01 PM
He means that the problem is not the NUMBER of hired employees, rather the QUALITY of the service.

However, it may be that because there are only a few employees they are so overloaded with things to do that they end up doing them half-assedly

Eos
2010-01-24, 09:07 PM
However, it may be that because there are only a few employees they are so overloaded with things to do that they end up doing them half-assedly

Personally I lean towards them not having a decent process.
Without having seen their game-play checklist it's hard to be sure though.

Nature
2010-01-25, 01:57 AM
I think its more of a general problem like most businesses you can hire as many people you need but doesn't mean they work together right? If only one person cares then everything slows down since the others one don't care. If you look at gms tespia only really a handful of people actually looked for bugs in the game. The majority was just doing things they couldn't do in the regular server. If they bring it back it should be only down 100 players making mwlb automaticlly able to test as well.

bored4ever86
2010-01-25, 02:15 AM
I'm curious why MWLB should be in auto?, shouldn't they be playing their own chars or better yet walking around reporting hackers etc like they are supposed to do? then again if they were "gone" for a couple days who would notice? not I....

I'd certainly throw my hat in the ring to help towards getting this accomplished but it seems that its more about we want tespia rather than we want less/no bugs....

Combattente
2010-01-25, 06:37 AM
Personally I lean towards them not having a decent process.
Without having seen their game-play checklist it's hard to be sure though.

Look, whatever way NEXON Korea uses with Tespia.. they just succeed on making it a successful test server. Why shouldn't NEXON America do the same? Just follow NEXON Korea's pattern, and they should be able to do it.

And before someone says: "but, content doesn't need to be tested as it already gets tested in NEXON Korea's test servers".. NOPE. Even if it does, new issues somehow come up with the transfer of the content to another version, therefore making the testing in KMST partially useless.

But yeah, I agree that the main problem is NEXON America's staff. If they can't manage to test content themselves, I don't think it would change much if other people did it and reported the bugs.. as they probably wouldn't be able to fix them in time.

Eos
2010-01-25, 06:41 AM
Look, whatever way NEXON Korea uses with Tespia.. they just succeed on making it a successful test server. Why shouldn't NEXON America do the same? Just follow NEXON Korea's pattern, and they should be able to do it.

Unfortunately your desired resolution is not saying this, it's guessing at what the actual problem is and trying to tell them how to resolve it or what to do about it, blind.

Combattente
2010-01-25, 07:38 AM
Unfortunately your desired resolution is not saying this, it's guessing at what the actual problem is and trying to tell them how to resolve it or what to do about it, blind.

Added that to the original post.

Amnesia
2010-01-25, 02:44 PM
Nexon should just ban permanently anybody from the programm if they submit ridiculous questions (Such as: OMGZ0R HOW I BE GM?!@#?$) or regular spam. This definitely won't stop people from spamming anymore, but the players at least will take it more seriously than before.

Combattente
2010-01-25, 03:17 PM
Nexon should just ban permanently anybody from the programm if they submit ridiculous questions (Such as: OMGZ0R HOW I BE GM?!@#?$) or regular spam. This definitely won't stop people from spamming anymore, but the players at least will take it more seriously than before.

Exactly. The main problem was that players didn't take it seriously enough. Also, there weren't any restrictions for round 2 and 3, so you can imagine the amount of idiotic people who got in.

Stereo
2010-01-25, 03:38 PM
Look, whatever way NEXON Korea uses with Tespia.. they just succeed on making it a successful test server. Why shouldn't NEXON America do the same? Just follow NEXON Korea's pattern, and they should be able to do it.

I don't know if it's still like this, but a few years ago Nexon America had no team working on game issues.

So the process pattern is
1) find a bug/glitch
2) tell Nexon Korea what's wrong
3) Nexon Korea fixes it
4) implemented for GMS

This doesn't work with Tespia style testing because there's too much time lag between steps 2 and 3 (around 4-6 weeks afaik). What's the point of letting players preview content a week in advance if none of the errors can reasonably be fixed by patch time? Nexon Korea can do it more directly because their testers speak korean, their devs speak korean, and it can be a much quicker back and forth process.

If a bug still exists at patch time, it's because 6 months ago when they asked for the content, they didn't end up with enough time to get everything working properly.

I guess the exception is game downtime - if a bug is preventing the game from working, they shortcut the process. I suspect this still takes about 24-36 hours to go through.


It's easier with a small dev team (like private servers have) because they don't have the same scale of operations, and generally a much looser schedule for releasing stuff.




I think the main area Nexon America lacks is in player communication. Even if we had Tespia, why should they read those reports any more than regular reports people submit? I could submit a report detailing exactly which monster frame is glitchy, how to fix it, and they would still ignore it.

Think about Bigfoot - he was missing a single flag to indicate he was a boss. It took 2 months to fix, because Nexon America can't make patches. They could only change the exp received.

Eos
2010-01-25, 03:47 PM
Think about Bigfoot - he was missing a single flag to indicate he was a boss. It took 2 months to fix, because Nexon America can't make patches. They could only change the exp received.

It's a sad irony that the average player with a repacker is more capable of fixing errors in the game than the actual releasing company.

Combattente
2010-01-25, 04:39 PM
It's a sad irony that the average player with a repacker is more capable of fixing errors in the game than the actual releasing company.

I agree.

And I also agree with everything Stereo has said, especially with the "lack of player communication" part.

I've always tried to talk with Nexon about their lack of communication with the players several times through tickets and their forums, but they always ignore me and all the other players.

Such a bad company doesn't deserve a B+ rating in the BBB.