{"id":2462,"date":"2024-12-28T19:49:29","date_gmt":"2024-12-28T23:49:29","guid":{"rendered":"https:\/\/lowtek.ca\/roo\/?p=2462"},"modified":"2024-12-28T20:06:40","modified_gmt":"2024-12-29T00:06:40","slug":"adventures-in-4k-ripping-4k-uhd-blu-ray","status":"publish","type":"post","link":"https:\/\/lowtek.ca\/roo\/2024\/adventures-in-4k-ripping-4k-uhd-blu-ray\/","title":{"rendered":"Adventures in 4K – Ripping 4K UHD Blu-Ray"},"content":{"rendered":"

\"\"<\/a>For my birthday a few months ago, I got a copy of The Matrix<\/a> in 4k. Previously I had only the original DVD that I bought when it first came out. I popped the 4k blu-ray into my blu-ray drive and started up MakeMKV only to discover that my system was unable to read a UHD<\/a> disc.<\/p>\n

Thankfully the 4k blu-ray comes with a normal blu-ray that contains a 1080p copy of the movie and I was able to rip that to my personal collection. While I do have a 4k capable TV, my primary projection setup is still only 1080p so having more bits available isn’t actually a better setup. Still, owning a 4k disc and not being able to use it bugged me.<\/p>\n

It turns out the MakeMKV folks run a forum, and there are recommendations there for the right drives to buy in order to rip the 4k discs. There is a thread Ultimate UHD Drives Flashing Guide Updated 2024<\/a> which is required reading if you want to get started. I also checked out CanadaComputers<\/a> which is my local go-to computer store, often having better prices than you can find online.<\/p>\n

My pick was the LG WH16NS40<\/a> which was both low cost, and appeared to be well supported by the MakeMKV forum. Of course, it isn’t as simple as buy the drive and rip 4k media, you need to modify the firmware. The fact that I had to modify the drive to get it to do what I wanted made this a must have item so it went on my Christmas list. Thankfully I was on the good list and when it was time to unwrap gifts I had my hands on a new drive.<\/p>\n

\"\"<\/a>Installing the drive into my Linux machine was pretty straight forward. I ended up replacing another older DVD drive I had in there. On the label of my new drive, I could see the model number (WH6NS40) and manufacture date (June 2024). There was also an indication of the ROM version (1.05).<\/p>\n

I run MakeMKV in a container<\/a>, for me this is a great way to encapsulate the right setup and make it easy to repeat. The new drive showed up just fine to MakeMKV – but I didn’t expect it to support 4k UHD discs just yet.<\/p>\n

I will summarize things further down, so you can skip to the summary<\/strong> if you want. However, the bulk of this post will be my discovery process on re-flashing the drive.<\/p>\n

Time to head off to the guide<\/a> and read it carefully.<\/p>\n

The first thing I took note of was the correct firmware I wanted based on my drive. This was in the “Recommandation” section near the top.<\/p>\n

WH16NS40 on any Firmware directly to > WH16NS60 1.02MK<\/p><\/blockquote>\n

So I want the 1.02MK version, and it seems I can get there with a single flash vs. needing to do multiple steps.<\/p>\n

A bit further down in the same guide, I came across<\/p>\n

LG 1.04+ \/ BU40N 1.03 \/ Asus 3.10+ and similar
\nThe newer OEM firmwares cannot be flashed easily due to the additional downgrade checks implemented by the drive\/firmware manufacturer.<\/p><\/blockquote>\n

Oh oh. So I may have problems? I am pretty sure I have the 1.05 firmware.<\/p>\n

As I read on, it seems the recommended flashing tool<\/a> is for Windows, and while I have a few Windows systems the drive is installed in a box that only has Linux on it. I spent some time reading through various forum posts and searching for other related material.<\/p>\n

At this point I have more confidence that yes, my drive is supported – but it\u2019s a question about how exactly to fix this drive (under Linux) to make it go. Bonus points if I manage to do this all inside of a container.<\/p>\n

I did find an older thread<\/a> that discusses flashing things under Linux. It pointed at a stand alone flashing tool on github<\/a>, but it was reading through this thread when I discovered that MakeMKV itself contains the sdftool<\/code> and supports the flashing process. This means I already have the tool inside the MakeMKV container.<\/p>\n

Here is how I run the container<\/p>\n

docker run -d \\\r\n    --name=makemkv \\\r\n    -p 5800:5800 \\\r\n    -v \/path\/to\/data\/makemkv:\/config:rw \\\r\n    -v \/path\/to\/home:\/storage:ro \\\r\n    -v \/path\/to\/videos:\/output:rw \\\r\n    --device=\/dev\/sr0 \\\r\n    --device=\/dev\/sr1 \\\r\n    --device=\/dev\/sg0 \\\r\n    --device=\/dev\/sg1 \\\r\n    --device=\/dev\/sg2 \\\r\n    --device=\/dev\/sg3 \\\r\n    --restart=unless-stopped \\\r\n    jlesage\/makemkv<\/pre>\n
For your system you will want to adjust the volume mappings and device mappings to match what is on your host system. This works great for me, and I can access both of the blu-ray drives on my system and write newly ripped files to my host filesystem.<\/p>\n
\"\"<\/a>Looking at the browser view of the MakeMKV container I can see that the new drive is recognized, and in the right side panel it even calls out the details for LibreDrive support.<\/p>\n
LibreDrive Information\r\nStatus: Possible (with patched firmware)\r\nDrive platform: MT1959\r\nHarware support: Yes\r\nFirmware support: No\r\nFirmware type: Original (patched version available)\r\nFirmware version: 1.05\r\nDVD all regions: Possible (with patched firmware)\r\nBD raw data read: Possible (with patched firmware)\r\nBD raw metadata read: Possible (with patched firmware)\r\nUnrestricted read speed: Possible (with patched firmware)<\/pre>\n
Shelling into the docker container, I can see that sdftool<\/code> is a link to makemkvcon<\/code>.<\/p>\n
$ docker exec -it makemkv sh\r\n\r\n\/tmp # ls -l \/opt\/makemkv\/bin\/\r\ntotal 37980\r\n-rwxr-xr-x    1 root     root         10921 Dec  7 17:27 autodiscripper\r\n-rwxr-xr-x    1 root     root      30579560 Dec  7 02:58 makemkv\r\n-rwxr-xr-x    1 root     root          1139 Dec  7 17:27 makemkv-set-key\r\n-rwxr-xr-x    1 root     root          1045 Dec  7 17:27 makemkv-update-beta-key\r\n-rwxr-xr-x    1 root     root       8077464 Dec  7 03:18 makemkvcon\r\n-rwxr-xr-x    1 root     root         85016 Dec  7 02:58 mmccextr\r\n-rwxr-xr-x    1 root     root        120760 Dec  7 02:58 mmgplsrv\r\nlrwxrwxrwx    1 root     root            10 Dec  7 03:18 sdftool -> makemkvcon<\/pre>\n
I had read about the possibility of dumping the original firmware as a backup plan in case things go very badly, but it seems this is actually not possible<\/a>. It seems the manufacturers have made this more complicated in the name of security or something.<\/p>\n
I grabbed the “all you need firmware pack<\/a>” from the guide<\/a>. This is a very small set of alternative firmwares, only one matches my LG ‘desktop’ sized drive so it was easy to identify the one I wanted to use.<\/p>\n
I also needed the SDF.bin<\/a> file that is hosted on the makemkv site.<\/p>\n
In theory, I have all the bits I need. The sdftool<\/code>, the SDF.bin<\/code>, and the modified firmware.<\/p>\n
At this point, I’m back following the guide. The Mac\/Linux portion which walks you through things. I can dump information about the current firmware from my drive<\/p>\n
# \/opt\/makemkv\/bin\/makemkvcon f -l\r\nFound 1 drives(s)\r\n\r\n01: dev_21:0, \/dev\/sr0, \/dev\/sr0\r\n  HL-DT-ST_BD-RE__WH16NS40_1.05_212005061440_KLRXXXXXXXX<\/pre>\n
Now I know the existing firmware version, it does not appear to be an exact match to the ones in the list from the guide under “Newer OEM Firmwares and encrypted”. However, the following is a pretty close match:<\/p>\n
HL-DT-ST-BD-RE_WH16NS40-NS50-1.05-N000900-212005061440.bin<\/pre>\n
This drive was made in June 2024 and most probably has a firmware from after 2020 – so a very close match to the list above, and the date of manufacture makes it very likely that my drive has ‘encrypted’ firmware.<\/p>\n
Ok – to recap what the plan looks like.<\/p>\n
    \n
  1. Grab the sdf.bin file<\/li>\n
  2. Download the modified firmware(s)<\/li>\n
  3. Dump existing firmware versions – determine if you are encrypted or not (likely you are)<\/li>\n
  4. Flash the drive<\/li>\n<\/ol>\n
    Easy right?<\/p>\n
    From outside the container we can copy in the firmware we need<\/p>\n
    $ docker cp HL-DT-ST-BD-RE_WH16NS60-1.02-NM00100-211810291936.bin makemkv:\/tmp<\/pre>\n
    And inside the container we can pull down the SDF.bin<\/code> file.<\/p>\n
    \/tmp # wget https:\/\/makemkv.com\/sdf.bin<\/pre>\n
    Then we just need to do the very scary flash part.<\/p>\n
    \/tmp # \/opt\/makemkv\/bin\/makemkvcon f -d \/dev\/sr0 -f \/tmp\/sdf.bin rawflash enc -i \/tmp\/HL-DT-ST-BD-RE_WH16NS60-1.02-NM00100-211810291936.bin<\/pre>\n
    There is a very long (minutes) pause where the flashing is taking place.. longer than I can hold my breath.. uh.. did I just make a brick?? fuuuuuu….<\/p>\n
    I can see from another terminal session that it is eating CPU, pegged at 100%.<\/p>\n
    After 10+ mins of hanging.. I hesitantly CTRL-C\u2019d the thing..<\/p>\n
    Thankfully, everything seems ok – I’m exactly where I started. Whew.<\/p>\n
    I found that adding the verbose (-v) flag was probably a good idea, and a forum thread<\/a> that indicated that there should be more output from the command. Maybe it’s getting stuck starting up?<\/p>\n
    I had a few thoughts. Maybe I need to run the container with less restrictions? (docker –privileged) No, that didn’t change anything.<\/p>\n
    Then I found someone having the same problem<\/a> recently. It seems the solution they used<\/a> was to just use Windows. I did ponder how I might setup a temporary Windows install to do this. Then I found this thread<\/a> that discusses MakeMKV hanging after loading the SDF.bin<\/code> file, this feels like it may be the same problem. In that case the issue is with the most recent version of MakeMKV (1.17.8).<\/p>\n
    I started looking for an older version of the container I’ve been using, one that has MakeMKV (1.17.7). It turns out that jlesage\/makemkv:v24.07.1<\/a> is a few tags back, but has that version. Let’s see if using this version will work better.<\/p>\n
    # \/opt\/makemkv\/bin\/makemkvcon f -v -d \/dev\/sr0 -f \/tmp\/sdf.bin rawflash enc -i \/tmp\/HL-DT-ST-BD-RE_WH16NS60-1.02-NM00100-211810291936.bin \r\nLoaded SDF.bin version 0x98\r\n\r\nReading input file \/tmp\/HL-DT-ST-BD-RE_WH16NS60-1.02-NM00100-211810291936.bin\r\nFlashing flags = 0x0 : 0 0 0 0 : ---- ---- ---- ----\r\nSending image in encrypted format\r\nThere is a disc in drive, please remove it and try again\r\nDEBUG: Code 4278542595 at wfCw3OE9o6xoDD[;$ZOJdpeNgiQob2>_:29396644\r\n\r\nCommand produced error code 0xff056103\r\n<\/pre>\n
    This seems to be much better, I’m now getting an error message instead of a 100% CPU hang. Also, apparently I need to remove the disc from the drive which is something I can do.<\/p>\n
    \/tmp # \/opt\/makemkv\/bin\/makemkvcon f -v -d \/dev\/sr0 -f \/tmp\/sdf.bin rawflash enc -i \/tmp\/HL-DT-ST-BD-RE_WH16NS60-1.02-NM00100-211810291936.bin \r\nLoaded SDF.bin version 0x98\r\n\r\nReading input file \/tmp\/HL-DT-ST-BD-RE_WH16NS60-1.02-NM00100-211810291936.bin\r\nFlashing flags = 0x0 : 0 0 0 0 : ---- ---- ---- ----\r\nSending image in encrypted format\r\nCurrent Drive ID: HL-DT-ST_BD-RE__WH16NS40_1.05_212005061440_KLRO6JI2348\r\nReady to write drive flash memory.\r\nType \"yes\" to continue, \"no\" to abort\r\nyes\r\nOperation started: Sending flash image to drive\r\n 100% Operation finished                                \r\nOperation started: Programming flash\r\n 100% Operation finished                                \r\nDone successfully\r\n\r\nCommand produced 0 file(s)\r\n<\/pre>\n
    I only very briefly held my breath as I typed in ‘yes’ and let it continue to do the work. It only took a minute or so to flash the drive and report success.<\/p>\n
    I needed to re-start the makemkv container. Then it was showing me my drive was good to go<\/p>\n
    \"\"<\/a>As you can see the LibreDrive information now shows<\/p>\n
    LibreDrive Information\r\nStatus: Enabled\r\nDrive platform: MT1959\r\nFirmware type: Patched (microcode access re-enabled)\r\nFirmware version: 1.02\r\nDVD all regions: Yes\r\nBD raw data read: Yes\r\nBD raw metadata read: Yes\r\nUnrestricted read speed: Yes<\/pre>\n
    And I can now read 4k UHD blu-ray discs without problem. I was able to rip the 4k version of the Matrix (53Gb) without issue. My setup was only showing [4x] speed, but I suspect this is more a limitation of my overall system vs. the drive which I suspect can go faster. I’m still very pleased to be able to pull the bits.<\/p>\n
    Summary<\/strong> – the TL;DR version<\/h3>\n
    Recent versions of the LG WH16NS40<\/a> can be modified to read 4k UHD blu-ray discs. This can be accomplished under Linux, using the MakeMKV container.<\/p>\n
    There is a bug in MakeMKV version 1.17.8 which causes it to hang with 100% CPU. Using version 1.17.7 still works as of the date of this post.<\/p>\n
    Absolutely read the guide<\/a>.<\/p>\n
    Start up the MakeMKV container<\/a>.<\/p>\n
    I downloaded the firmware bundle<\/a>, and picked the matching one for my drive. I then copied it from my host filesystem into the container<\/p>\n
    $ docker cp HL-DT-ST-BD-RE_WH16NS60-1.02-NM00100-211810291936.bin makemkv:\/tmp<\/pre>\n
    Then shell into the container and download the SDF.bin<\/code> file.<\/p>\n
    $ docker exec -it makemkv sh\r\n\r\n\/tmp # wget https:\/\/makemkv.com\/sdf.bin\r\n<\/pre>\n
    Now we issue the flash command<\/p>\n
    \/tmp # \/opt\/makemkv\/bin\/makemkvcon f -v -d \/dev\/sr0 -f \/tmp\/sdf.bin rawflash enc -i \/tmp\/HL-DT-ST-BD-RE_WH16NS60-1.02-NM00100-211810291936.bin \r\n<\/pre>\n
    That’s it. We have a modified firmware installed.\u00a0 Time to enjoy 4k goodness.<\/p>\n","protected":false},"excerpt":{"rendered":"
    For my birthday a few months ago, I got a copy of The Matrix in 4k. Previously I had only the original DVD that I bought when it first came out. I popped the 4k blu-ray into my blu-ray drive and started up MakeMKV only to discover that my system was unable to read a … Continue reading “Adventures in 4K – Ripping 4K UHD Blu-Ray”<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5,12],"tags":[],"class_list":["post-2462","post","type-post","status-publish","format-standard","hentry","category-home-theater","category-how-to"],"_links":{"self":[{"href":"https:\/\/lowtek.ca\/roo\/wp-json\/wp\/v2\/posts\/2462","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lowtek.ca\/roo\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lowtek.ca\/roo\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lowtek.ca\/roo\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/lowtek.ca\/roo\/wp-json\/wp\/v2\/comments?post=2462"}],"version-history":[{"count":4,"href":"https:\/\/lowtek.ca\/roo\/wp-json\/wp\/v2\/posts\/2462\/revisions"}],"predecessor-version":[{"id":2470,"href":"https:\/\/lowtek.ca\/roo\/wp-json\/wp\/v2\/posts\/2462\/revisions\/2470"}],"wp:attachment":[{"href":"https:\/\/lowtek.ca\/roo\/wp-json\/wp\/v2\/media?parent=2462"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lowtek.ca\/roo\/wp-json\/wp\/v2\/categories?post=2462"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lowtek.ca\/roo\/wp-json\/wp\/v2\/tags?post=2462"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}