Q2 2016 progress report
#1
Progress report q2 2016

Hey everyone and welcome to another spectacular PCSX2 progress report! As you may have read in the last report we have moved from doing reports monthly to quarterly in order to better focus our manpower. Today's report is our first quarterly report and as such there are quite a lot of improvements and changes to go over. Before we do that however we need to ask for your help!

As you probably know PCSX2 is cross platform and runs on Windows and Linux. Because of this we need testers for each of those platforms in order to be effective at developing for them. Currently we have a very problematic lack of testers on Linux. We would like to take this opportunity to invite those of you with Linux experience to help the project out and become a Linux tester! Ideally you should be completely comfortable working in Linux (whatever flavor you choose as long as PCSX2 is compatible with it!) and you should have or be willing to develop the knowledge to debug various issues with the emulator in that environment. If this sounds like you and you want to help us out then please head over to http://forums.pcsx2.net/Thread-Q2-2016-progress-report and let us know!

With that out of the way let's jump right in to the PCSX2 progress report for Q2 2016! Strap yourself in for the ride because here we go!


[Enhancement]   OnePAD: Updated GUI by kust2708

onepad gundam

OnePAD is the default pad plugin for PCSX2 on Linux. Recently kust2708 updated OnePAD's UI to make it a bit nicer and more user friendly. Instead of the drab gray buttons laid out in a sort of Dual Shock arrangement users can now much more intuitively configure their controllers with a nice Dual Shock 2 graphic.


[Enhancement]   Core: Automatic aspect ratio switch during FMV playback by FlatOut

auto aspect ratio switch

Most games with a widescreen option (through either in-game setting or widescreen patch) have FMVs that are fixed to the original 4:3 aspect ratio. Those videos will appear horizontally stretched when playing a game in widescreen. This new option automatically switches PCSX2's aspect ratio to 4:3 when an FMV begins and back to widescreen when it ends, so both the in-game part and the FMV's are displayed correctly.


[Bug-Fix]   CDVDgigaherz: Fixed dual layer DVD reading by turtleli

Dual layer DVDs have never worked properly with CDVDgigaherz and it turns out that there were quite a few issues:
  • DVD layer information sector addresses were not converted from big endian to little endian.
  • Windows filesystem drivers prevented layer 1 sectors from being read due to boundary checks.
  • Dual layer DVDs were reported to PCSX2 as having multiple tracks, when all single session DVDs only have one track.
  • Generation of the Table of Contents was skipped.
  • The layer break address was off by one.
  • PTP DVDs were wrongly recognized as OTP DVDs.
These issues are now fixed so dual layer DVDs should now be playable with CDVDgigaherz. A list of games affected by this change can be found on Wikipedia.


[Enhancement]   CDVD: Improved ISO layer break detection algorithm by turtleli

When using large DVD ISOs (>4.3GB e.g.  dual layer DVDs) a brute force approach was used to detect the layer break address. The algorithm would start from the middle of the ISO and search outwards until the layer break was found.

This approach wasn't optimal due to the following reasons:
  • PCSX2 would appear to be unresponsive while it searches for the layer break address the first time the ISO is booted.
  • The layer break address needs to be cached to speed up subsequent loads.
  • If there is no layer break, the entire DVD would be searched each time the ISO is booted - this could take a few minutes.
Doing it this way was unnecessary. The DVD layer 0 Primary Volume Descriptor contains the total number of sectors on layer 0 of the DVD. For a single layer DVD this is equal to the total DVD sector count. For a dual layer DVD, however, this sector count is equal to the first logical sector number on layer 1. Using this knowledge a much faster and simpler layer break search algorithm was implemented.


[Enhancement]   GSDX: Fast texture invalidation by Gregory

Not too long ago the half screen issue caused by the texture cache was fixed for Snowblind engine games. However even with this fix the games were still too demanding even for beastly machines. In order to figure out why, a GS dump was profiled. The profile revealed that a single loop in the texture cache management code was very busy. The loop in question was responsible for computing the block invalidation of certain special textures. They are special because the width of the buffer which contains them is smaller than the width of the texture in texels. As a result, when a block is invalidated all the repeating blocks must also be invalidated. The texture then becomes like a Swiss cheese full of holes which requires uploading lots of small textures to fill. Doing it this way is very efficient at reducing the usage of PCIe bandwidth but unfortunately it requires too much CPU time.

In order to resolve this issue, we skip the block invalidation and completely invalidate the whole texture instead. This avoids the busy loop we discussed above. The texture is then uploaded in one go instead of many small uploads which greatly reduces the driver overhead. As a trade-off it increases the PCIe bandwidth requirement by 20-30%. However at this point PCIe is up to the third generation (and soon the fourth) so a good deal of bandwidth is available. Benchmarks show that this change produces a nice speedup - however some scenes were still too slow.

Further profiling revealed that the game reads the render target a lot. This is slow because you need to flush the full GPU pipeline first. Nothing can be done about this part unfortunately. But next you need to transfer the GPU data to the CPU. Before we were transferring the full framebuffer which is millions of pixels. However the game only needs data for a few hundred of them. Gregory updated the code to transfer only the useful pixels.

These two improvements combined provided a major speed boost for Snowblind engine games. They are almost two times faster now! If you have a good processor with an Nvidia GPU then you should be able to enjoy them in full upscaled glory now!



Speed Impact of Fast Texture Invalidation
Game 1.4.0 Release 1.5.0 w/FTI
Baldur's Gate: Dark Alliance 30 80
Champions of Norrath 52 105


[Bug-Fix]   GSDX: Improved detection of Framebuffer size by ssakash

Previously the height of the framebuffer was calculated using guesswork based on the width of the framebuffer. This method was obviously wrong and it caused some conflicts when scaling the buffer for upscaled resolutions. This was fixed by using the height of the output circuit as a base for the framebuffer height.

Here are some comparison screenshots showing the issues fixed by this change:


Crash Nitro Kart

Crash Nitro Kart Before Crash Nitro Kart after

Richard Burns Rally

Richard Burns Rally Before Richard Burns Rally after


[Bug-Fix]   GSDX: Enable reading of Depth Buffer by Gregory

There are certain scenarios where the Core (EE) reads the depth buffer to free the GS memory (4 MB) and do some effects. During this time the buffer is saved in the EE memory (32 MB) and is restored after the completion of said effects.

Gregory has emulated this behavior by converting the GPU depth buffer to GS format and by sending it to the EE when it wants to read the depth buffer. This implementation has finally fixed the lens flare issue on Kingdom Hearts II and also some depth related issues on ICO and Nocturne.

Kingdom Hearts 2 Before Kingdom Hearts 2 after

ICO Before ICO after


[Bug-Fix]   GSDX: Improved PCRTC merge circuit emulation by turtleli and ssakash

In some cases the GS is configured to use two side by side display rectangles for rendering. The rectangles are merged by the GS's merge circuit and the resulting image is sent to the TV.

The horizontal position of the display rectangles, however, was ignored when emulating the merge circuit, which caused image overlap issues where only half the image was displayed. The display rectangles' horizontal position is now taken into account, which fixes the image overlap issues and makes split screen mode in Time Crisis 2 and 3 playable.

Time Crisis 2 (before) (320 X 224)

Time Crisis 2 Before


Time Crisis 2 (now) (640 X 224)

Time Crisis 2 after


[Bug-Fix]   VIF: Timing fix for MSCALF, MSCNT instructions by Refraction

Previously the MSCALF and MSCNT instructions were delayed along with the MSCAL instruction, these instructions trigger the execution of the micro instructions in VU1. This was done in order to fix the graphics on the Snowblind Engine games such as Baldur's Gate: Dark Alliance and Champions of Norrath; However, delaying this seemed to cause quite a few shadow problems on games like Downhill Domination, Twisted Metal and potentially other games.

Refraction fixed these issues by reworking the code to only allow delays for the MSCAL instruction.

DownHill Domination before DownHill Domination after

Twisted Metal before Twisted Metal after

As usual, there were even more additions and developments while this report was being written but they will be included in our next quarterly report.
Thanks to everyone who worked on this, ssakash, refraction, gregory, dogen, Nobbs66, FlatOut, turtleli and a special thanks to Blyss Sarania, the whole team is by his side through the rough times he is going through.
[Image: newsig.jpg]
Reply

Sponsored links

#2
I'd love to be a Linux tester.
I could try to contribute to the source code in some way too.

Let me know what needs to be done.

Umair
github.com/omerjerk
Reply
#3
(06-17-2016, 01:48 PM)omerjerk Wrote: I'd love to be a Linux tester.
I could try to contribute to the source code in some way too.

Let me know what needs to be done.

Umair
github.com/omerjerk

If you're looking to do linux development, gregory has done areas of interest here: http://forums.pcsx2.net/Thread-Areas-of-...developers Smile
[Image: ref-sig-anim.gif]

Reply
#4
(06-17-2016, 02:13 PM)refraction Wrote: If you're looking to do linux development, gregory has done areas of interest here: http://forums.pcsx2.net/Thread-Areas-of-...developers Smile
Well honestly, list is quite out of date. I really need to update it. I think the one on github is more recent (well barely).
https://github.com/PCSX2/pcsx2/wiki/Cont...DO-List%29

You could also check issue/pr on https://github.com/PCSX2/pcsx2

Personally, I would love the .iso.xz support. xz supports a block format so you don't need to generate index.
Reply
#5
I'd be up for testing some things on 64 bit Gentoo w/ nVidia.
Reply
#6
I am also up for testing and helping out. I got Korora 64-bit w/ Nvidia.
Reply
#7
Okay, I got to ask. What's up with Blyss? That guy is awesome. I hope his health is okay
Reply
#8
(06-18-2016, 12:23 AM)Canes Wrote: Okay, I got to ask. What's up with Blyss? That guy is awesome. I hope his health is okay

He's dealing with some pretty personal stuff in real life at the moment. He's fine health wise, but he's going through some stuff.
[Image: gmYzFII.png]
[Image: dvedn3-5.png]
Reply
#9
(06-18-2016, 12:50 AM)Nobbs66 Wrote: He's dealing with some pretty personal stuff in real life at the moment. He's fine health wise, but he's going through some stuff.

Health above all else so I'm glad he's doing good in that regard.

Anyways, was super excited about that fix on the Snowblind engine games. Unfortunately Witcher 3 on a toaster would still run faster...probably.
Fast texture Invalidation does noting, at least for me.
Not there yet I guess, but good progress guys.
Reply
#10
I'd love to help test things out on Linux. Running 64-bit Ubuntu with Nvidia's proprietary drivers.

Great work on the emulator by the way.
Reply




Users browsing this thread: 3 Guest(s)