About Nerd Drivel

Knowledge is power. Empower yourself! I've been a computer nerd since I was 7 years old. I started in the days of the Power PC with a Commodore 64. As I grew so did my knowledge and curiosity, anything I could take apart with a screw driver would be opened and investigated. Later on I went on to graduate from a post secondary Computer Engineering program. Today I work in an IT department for a mid sized company, I get to tinker and toy with gadgets of all types, fuelling my passion for technology and software. I understand computers more than I understand some people.

Home Media – Part 4 – OSMC/KODI/XBMC

This is part 4 of a series of write ups called Home Media.

Part 1 – The NAS build

Part 2 – The Setup

Part 3 – The Rip

Now that you have a whole infrastructure setup for streaming in your house, what do you do?

First thing is first, you will need some sort of hardware. Be it an old laptop, a Odroid-C2 box, an Android Box or a Raspberry Pi3. Then you will be creating two xml files called Sources.xml and/or AdvancedSettings.xml. These two files are responsible for media sources and database connections respectively. With Advancedsettings in the mix you can also add an SQL instance to your setup.

The benefit to the SQL database is that if you have multiple devices in your home, you can pause your content in one room and resume it in another. Your library info is stored in one place, the databse, and can be easily backed up and restored using software such as HeidiSQL. Library updates can be performed using headless installations of KODI and are picked up by all other devices on the network connected to the DB.

Easiest way to run a headless installation of KODI is to use the LinuxServer.io docker container which they have created and is available from here https://github.com/linuxserver/docker-kodi-headless. This works well if you have a server at home. If you are running a Pi or Odroid device with KODI on it this might not be necessary, since these are always on low power devices. Potentially you can send all update requests to these boxes.

For Laptop and Android Boxes go to their respective app stores and install KODI. On Linux you have to install KODI manually. Head over to Kodi.TV and they have all the packages you need over there. For further installation instructions head over to the KODI wiki.

In this example I will be working with v17.x or K, code named Krypton. For the Odroid-C2 and RaspberryPi I suggest heading over to LibreELEC and grabbing the installation source from there. The equivalent LibreELEC version of KODI version 17 is 8.x. For the Odroid and RPi you will need to image the storage device, SD card or eMMC storage. On Windows use the Rufus software. Alternatively LibreELEC has built their own installation tool to install the OS on a storage device. For further installation instruction for LE suing their tool go to their wiki site. An alternative to LibreELEC is OpenELEC, this has builds for devices that Libre does not support.

Note that when you boot in to KODI for the first time, specifically LibreELEC, you should enable SAMBA and SSH. SAMBA will be useful for copying the xml files to your KODI box later on.

Installation:

Once you have installed Rufus and plugged your SD/eMMC card to your computer start Rufus and locate the drive letter that is the storage device of your choosing.

In Rufus click the drop down list and select DD Image, then to the right of it click the image icon.

Rufus will prompt for a file with a Open selection window. Select the appropriate image and click Open.

It will warn you about erasing all the data on the storage device, accept the prompt and let Rufus run through it’s thing.

Once complete close Rufus and check that your file structure of the SD card look something like the above. The storage device is now ready to be plugged into your hardware and you can proceed to boot it.

Database:

Install the database of your choice. I use MariaDB, it’s a free open source SQL software. It was forked after MySQL was bought out by Oracle. I run this in a docker on my home server. However you like to proceed pick the installation of your choice.

The docker container is available on the Docker hub and can be found here: https://hub.docker.com/_/mariadb/

To run the docker with persistent storage run the following docker commands.

First you need to pull the installation.

docker pull mariadb:latest

An alternative to the latest tag you can use the versions available on the site, 5, 10… etc. Then you will need to run the docker using the docker run command. It will look something like the follwing.

docker run -d –restart=always –net=bridge –name mariadb -v /my/own/datadir:/var/lib/mysql -e MYSQL_ROOT_PASSWORD=SomePassword -e MYSQL_USER=kodi -e MYSQL_PASSWORD=kodi -p 3306:3306 mariadb:latest

For Unraid 6 you can use a Docker MariaDB template available here:

https://github.com/Exist2Resist/docker-templates/tree/master/exist2resist

There are 3 key commands you need to execute on the database after you have installed it. You can find the database installation instructions for various OS versions on the KODI wiki.

Make sure after you setup a sa or root user on the database you write down the password. After this log into the database and run the following 3 commands.

  1. Type in: CREATE USER 'kodi' IDENTIFIED BY 'kodi'; and press return
  2. Type in: GRANT ALL ON *.* TO 'kodi'; and press return
  3. Type in: flush privileges; and press return

These commands create a user with the name kodi and password kodi. This will be used in your KODI installations via the advancedsettings.xml file to connect to the database.

sources.xml:

The sources file is used to connect KODI to your network shares and sources for your media and music. A sources file has the <sources></sources> tags at the beginning and end of the file and should look something like the following…

smb: stands for samba, your other option would be nfs which is the file sharing protocol in linux. Also if you notice the above shares are accessible to anyone on the local network. If you want to password protect these shares go ahead but you will need to change the <path>, using the example above to smb://username:password@Tower/Music/.

The sections (<music>), name (<name>) and path(<path>) are all mandatory in the example above. Every other field is optional.

Note that if you are using a database to store the media information you do not need the sources.xml file on all your instances of Kodi. You will only need both files on the instance which updates the library and database. All other instances only need to connect to the database. The database contains a files table which has an idPath column that stores the path to the files.

For further detail on the sources xml you can head over to the KODI wiki, http://kodi.wiki/view/Sources.xml

Note that with the database in the mix you should enable the option to wait for network before starting KODI. This is only available in OpenELEC and LibreELEC builds of KODI. I have not been able to find this in the vanilla KODI, but that should not matter as more than likely these installations will usually run on a box that requires manual KODI start anyways.

advancedsettings.xml:

The advanced settings file has the <advancedsettings></advancedsettings> tags at the beginning and end of the file and below is an example of what the advancedsettings.xml should look like. This file is very fickle and it has a lot of options it can take. Use the example below as a starting point.

<videodatabase> and <musicdatabase> point to an sql instance via the IP address username and password. Default port for sql is always 3306.

Also if you want to pause and resume your playback at different locations in your home, include the <importwatchedstate> and <importresumepoint> tags and set them to true under the <videolibrary> tag. Under the same tag <backgroundupdate> updates the library without any popups of notifications. <recentlyaddeditems> sets the amount of new items that will be visible under the TV Shows and Movies sections. Default I believe is 25, you can set this to whatever.

In version 17+ of KODI the cache tag is pretty important. If you are experiencing the odd buffering interruption while watching content from your file server set this option and have all content buffer.

In previous versions of KODI this option was set under the network tag. Sections 2.8.4 and 2.8.3 of the Advancedsettings.xml wiki, respectively.

Cache buffers the file in memory instead of the local storage. If you notice a lot of stutter on your streams, especially with version 17 if you add this sections the performance should greatly improve. Mind you if you have terrible internet and you are using external or http video sources there are no guarantees. If want to do this you will need to do some math first, use this bit calculator if you’d like, don’t trust google they mess the calculation and conversion up badly. But more on that later.

The cache section looks something like the following.

<cache>
<buffermode>1</buffermode>
<memorysize>477184000</memorysize>
<readfactor>10</readfactor>
</cache>

Buffer mode with value of 1 will cache any content streamed in KODI. Local or remote it doesn’t matter.

Memory size is where you will need to do some converting and calculating. So the max memory size depends on your system and this value can not exceed a third of your max free memory. So if your device is running while playing content with 300 MB of free memory your max memory size should be 100MB or 104857600 bytes. If you don’t adhere to the 1:3 ratio rule, there is a high probability that your box will crash.

Read factor is the speed at which the content gets buffered at or read into memory at. If a files average bit rate is 6MB/s, with a read factor of 10 the file will be read at 60MB/s into the cache buffer. Average bit rate multiplied by the read factor. Take your network bandwidth into consideration when calculating this. If not specified the default is 4.

For further details on the advancedsettings xml you can head over to the KODI wiki http://kodi.wiki/view/Advancedsettings.xml

File placement:

If you enabled SAMBA and SSH on your KODI device you can navigate to the Userdata share of the device and place both xml files there. Even though you don’t need both it is recommended that you do. The network name or IP will be required for you to navigate to the shared folder. You should have enabled SAMBA when you set up your KODI box. During said setup you gave the installation a name, if you kept it default navigating to \\LIBREELEC via file explorer should bring up the box’s shares.

Open up the Userdata folder and you should see some folders and 4 xml files.

Place both the XML files in here.

Alternatively you can SSH into your box using putty or similar software. Default user name is root and the password is libreelec.

Once in there you can use either vi or nano to create both the files and paste the contents. The location of where the file should be stored are as follows.

/storage/.kodi/userdata/

You can create the files manually by performing the following commands in SSH.

nano advancedsettings.xml

Then paste the contents of the file into the window and click ctrl + x, this will prompt you if you want to save the file, type in y and hit enter to confirm the file name.

Repeat the same for the sources file.

A very important step, you will need to set KODI to wait for the network when it boots if you are using a db connection. If you do not do this your library will not populate.

In your add-ons select the LibreELEC Configuration add on.

Then set the Wait for network… option and set it to 10 second. There has not been an instance where 10 seconds has not been enough for me.

Your KODI box should now be ready to go, reboot and enjoy.

Advertisements

Veeam VM Backup software restore agent timeout fix.

Veeam Backup and Replication software is a very popular Virtual Machine backup software at the moment. It is very robust and offers a lot of options for backing up and moving your virtual infrastructure off site.

Recently after setting up the software I discovered that after about 11 hours of a restoration processing of a 4TB MSSQL vm backup the software would hang and the restore would fail.

After about 3 weeks of back and forth with Veeam support and digging into the software my entire infrastructure and even my SAN. The developers came back with a registry entry fix that prevents the software from hanging on restore. This registry needs to be added to the Veeam Server,  Veeam Proxies, and Veeam Repositories.

Essentially you need to add this to any and all installations of Veeam in your infrastructure. Then all you do is Restart the Veeam Transport Service, named Veeam Data Mover Service. Alternatively reboot any and all servers.

The registry entry you need to add is as follows;

name: HangedAgentKillTimeout
path: HKLM\SOFTWARE\Veeam\Veeam Backup Transport
type: REG_DWORD
value: 28800

You can also put the following in a batch file if you’d like.

Reg Add “HKLM\SOFTWARE\Veeam\Veeam Backup Transport” /v HangedAgentKillTimeout /t REG_DWORD /d 28800

QLED vs OLED, not the same tech.

Update: OLED is not without it’s issues. One issue is reverse vignette, this is where the screen appears darker on the inside than the outside. Vignette is an effect that you see in some photos and even in movies, inside is brighter than the outside. Sometimes done purposefully, other times it’s due to the use of a wide angle lens, it bends the light in such a manner that it creates the effect. You can remove reverse vignette on an OLED panel by adjusting the OLED light, contrast, and brightness of the screen. This is not noticeable in content however, and you really have to look for it in order to see it.

Vignette effect.

/Update.

I just saw what Samsung is charging for their new QLED TV sets, and are they insane? They are marketing their new television line as some form of LED technology, then pricing it similar to what LG is charging for their OLED sets. Well let me tell you, one is better than the other. I’m writing this article in the hopes that you won’t get fooled in to buying one of those over priced LCD screens from Samsung.

There are two types of OLED (Organic Light Emitting Diode) technologies. W-OLED and RGB-OLED. Samsung bet all it’s money and research on RGB OLED, and lost. They have since dropped out of the OLED panel race. Due to RGB-OLED high price and degradation of the blue OLED pixel this technology proved to be too expensive to manufacture for large format displays. LG opted for the W-OLED or White Oled technology, which is a white LED with RGB filters. LG won, this is the perfect OLED technology for large format displays and soon other manufacturers will follow LG in their footsteps.

After dropping OLED panels as a display technology Samsung released new branding for their LCD panels, they called this QLED or Quantum Dot Light Emitting Diode. The description of this technology is somewhat based on a lie or false promise. I believe this branding is meant to fool the consumer into believing they are buying something that the technology is not. There are no Light emitting diodes or LEDs inside the QLED panels. QLED is a passive LCD screen with a quantum dot colour filter and LED edge lighting. The only difference between QLED and an LCD/LED TVs (LED is an LCD panel with LED edge lighting) are the quantum dot filters, everything else is business as usual.

QLED sounds like OLED, but OLED it is not. While the W-OLED and QLED technologies on paper may look and sound the same, the name is where this similarity ends. I believe that Samsung QLED technology is inferior to LGs OLED and Samsung will lose a lot of market share due to it’s price and the underlying technology of using LCD panels.

OLED is an emitting technology, each pixel is capable of producing it’s own light. Benefits to this are that OLED panels have infinite contrast ratios as each pixel can be individually turned off and on. Blacks are true black, similar to what plasma and crt televisions were capable of offering in the past. OLED is a natural replacement for Plasma Television owners and Home Theater enthusiasts. OLED screens can be viewed in a bright room, even when you have sunlight hitting the screen.

QLED on the other hand is a LCD panel with a passive colour filter(quantum dot layer) and an edge LED array which is used as a back light for the screen. If sunlight hits your screen it renders the image unwatchable. QLED sets might be held to a higher production standard than normal LCD panels however they still come with issues such as banding, light bleed, uniformity concerns, and motion blur. Even with local dimming that QLED panels possess, they have a lot of light bleed. In bright rooms, unlike OLED, QLED screens wash out and become unwatchable. In dark rooms the light bleed from the back light detracts from the viewing experience.

OLED sets have virtually no motion blur, no light bleed, no banding, near perfect uniformity, and are perfect for viewing at an angle with virtually no colour shift. I say virtually because sometimes the light refraction coating on top of the screen can make whites appear with a slight pink/purple tint. This happens primarily when viewing the screen at an angle. The tint shift effect of the refraction coating is not very significant, and even with this shortcoming of the LG OLED screens they still look much better than any high end LCD panel I have laid eyes on. Have a look at the picture it demonstrates the coating tint shit effect. Note the left side of the screen is slightly warmer than the right side.

Yes quantum dots much like OLED do produce more saturated colours. But at the price Samsung wants to charge for a set you are better off picking up an OLED set from 2016. The 2016 LG B6 series can be picked up for around $ 2500 USD, and I guarantee you the picture quality is better than anything Samsung can offer for twice the price in their QLED lineup. Sony and others are also getting into the OLED Television game and some more sets are on the way to market. OLED prices are being driven down and they are becoming more affordable. QLED might soon be a technology of the past. If Samsung is not able to decrease the price and improve the quality of QLED displays OLED will be the clear winner. Even with some of the OLED shortcomings, such as brightness fading, this technology has a lot more benefits than QLED. I use mine as a monitor too, while there is some image retention I have not noticed it and retention on W-OLED is not permanent. OLED sets are closer to the picture quality of CRT and Plasma televisions than any LCD on the market right now. Also SDR (vs HDR on Samsung) content looks much better on an OLED panel.

The bottom line is Samsung could not afford to stay in the OLED game with their RGB-OLED tech. Now Samsung is trying to sell you an inferior technology marketed as something that it can not compete with. W-OLED screens are cheaper to produce and produce a better visual experience.

Update: There have been some cases of Burin-in with LG OLED TVs. The culprit is the colour Yellow and some derivatives of it. So Red and Green can also cause the issue, the closer to yellow these colours get the worse the problem. LG is denying any warranty claims on Burn-In on the OLED screens. Same issue is plaguing the Google Pixel 2 that carries LGs OLED screens.

So if you own a LG, Sony, or Panasonic OLED TV, one way to prevent burn in with yellow colour is turning your TVs OLED light down below 40, also change your compensation cycle to run every 2 hours instead of 4. TV channels with static colour logos are not a good fit for these TVs.

Having said this, OLED picture quality is still superior and for movie and series watching is amazing. Be aware of these short comings and like most consumers that bought Plasma TVs you can avoid the burn-in.

For more information on this issue head over to this AVSForum thread.

References:

https://en.wikipedia.org/wiki/Quantum_dot_display

https://www.oled-info.com/oled-tv

http://www.businesskorea.co.kr/english/news/industry/2891-w-oled-vs-rgb-oled-samsung-lg-show-different-techs-large-displays-ces-2014

HDR is here, sigh…

First, here is a good quick article on the difference of 8-bit vs 10-bit colour. Give it a quick one, two. Thumbs up the guy that took the time to write that.

My opinion is as follows.

First HDR should not be called HDR. It should be called Colour+ or something. Because it’s not what traditional HDR is or does. There are 3 HDR formats as of this writing, HDR, HDR10+ and, Dolby Vision.

HDR offers a singular benefit which is the colour depth, but as is with Dolby and Samsungs HDR10+ everything else about it is a gimmick. Just like Curved screens, and the likes of 8K Televisions. Perhaps 8K is useful for larger cinema screens but to me as a consumer 8K won’t offer any value in the near future. HDR offers a singular benefit, this is the wider colour gamut or depth(10 bit vs 8 bit). This has been a long ways in the making and started in the days of DVD past.

While yes the capability of the wider colour gamut or depth is welcome, things such as changing meta data is riding on borderline gimmicky and stupid. Also I would prefer there be no changing meta data in my video streams, thank you very much. I’d rather my Television have less capability to spy on me than they already do. I’m looking at you Samsung. I don’t own any Samsung products by the way, and there is a good reason for that, explosions and spying aside, I don’t buy into what they sell. While LG has adopted HDR and Dolby Vision(Netflix), Samsung has opted for HDR and HDR10+(Amazon). Amazon opted to adopt the HDR10+ standard.

I have experienced both Netflix and Amazon HDR, except for HDR10+ on Amazon. Based on my experience I will say this; the quality of Netflix and Dolby Vision leaves something to be desired. While it can offer benefits for edge lit LCD panels I see no benefit for OLED TVs. The idea behind Dolby Vision is such that it adjusts the contrast and brightness levels so that one can see the darks or shadows in a scene better and with greater detail than before. Is this true? Yes, somewhat but it comes at a price. To me it reeks of gimmick that only Edge Lit LCD panels benefit from. Let me explain. The problem with edge lit LCDs is that if a single pixel on the screen needs to be lit, and depending on the TV weather it has local dimming zones or not, the entire screen or sections of it will be lit up with the back light to provide illumination to the single pixel. LCD pixels are a passive technology and do not emit light. That is not the case with OLED. This means that on LCD/LED/QLED panels you will see a beam of light dropping down from the top to the bottom for a single pixel on an edge lit LCD panel, or LED panel as the manufacturers like to call them. QLED does something similar as well. While Dolby Vision aims to minimize this. Testing DV(Dolby Vision) on the LG 65UH8500 which is an LED edge lit LCD TV, this effect is very noticeable. Dolby Vision somewhat corrected this problem, but I also noticed that the contrast, the whites and, overall brightness of the image suffered in DV. Having watched and tested many DV shows, it was all the same across the board. Most noticeably in Luke Cage, DV rendered the image and show unwatchable and I had to make adjustments to the DV settings. Note that this was a calibrated television screen. In Marco Polo it did improve the dark scenes, however during the bright scenes I noticed that the colours and whites were way off. The whites weren’t white anymore and colour had a dark brown tint to it. But then again Netflix streaming quality is nothing to rave about. While Amazon streaming quality is slightly better than Netflix, this is only true for their UHD stuff. Also Amazon’s HDR implementation is a little simpler than DV and having watched the Grand Tour in HDR I can say, it’s just ok. HDR is simple and does what it’s supposed to without gimmicks. It adds a larger colour gamut, while HDR10+ and Dolby Vision add changing meta data to the stream. Thanks but no thanks.

The likes of 4 HDR standards exist right now, or soon will. Each vying for TV supremacy.
This smells to me like the next format war, Beta Max vs VHS, HD-DVD vs Blu-Ray, well Dolby Vision vs HDR10+ is here. So get ready folks, get ready to stop buying new TVs because a new format war is about to come to your living room.

Also did you know that that UHD television in your living room will not display UHD Television content for a long time, if ever, except for a couple channels. For the most part TV producers opted for HDR instead of UHD resolution. On top of that, said live television HDR format is a new standard which has not been added to any TV manufacturers lineups yet. Planned obsolescence? Maybe. Who knows maybe it’s just a firmware update, but if you’re dreaming of watching sports in UHD, think again, it might not ever happen. Yes Direct TV streamed some UHD channels last year, but have a look around, most Television broadcasts are still in 720p or 1080i, nothing has changed in the last little while.

So as it stands right now the only benefit HDR offers is via UHD-BluRay. You get uncompressed HDR video with wider colour range and uncompressed audio. However, UHD-BluRays aren’t flying off the shelves either. I have a sneaking suspicion that UHD BluRay will go the way of BetaMax, HD-DVD, and the Dodo. As such I could not recommend a new LCD panel that supports HDR at the moment to anyone. Let alone UHD LCD panel, that is unless you plan to use it with a PC. There really is no benefit at the moment to the average consumer purchasing a UHD TV unless you are buying a large format screeen, 80″ + I’d say. Be patient, sit and wait, watch, and then make an informed purchase.

If you’re are going to upgrade your LCD panel do it because you’re upgrading it to an OLED TV. That is the single best upgrade you can make to your TV, you will be stunned at the difference between OLED and LCD. Once you look at OLED you will realize how trashy LCD, LED and, Samsung’s QLED panels really are. This is truly the future of Television displays, and Goggles rumored $800 Million investment in LGs OLED technologies is proof of that. Christ, go to any robotics hobby shops and they are stocking OLED monochrome displays, some even colour. OLED is the future display tech for the time being. QLED or Quantum dot Light Emitting Diodes are just LCD panels with a gimmicky name to try and fool you into buying Samsung’s panels which are LCD/LED edge lit displays of the last 10 years past.

OLED or go home I say. This is what the industry should be concentrating on.

References:

http://www.techhive.com/article/171223/10_bit_color.html

http://www.digitaltrends.com/home-theater/directv-4k-uhd-masters-broadcast/

http://www.cnbc.com/2017/04/10/google-offers-at-least-880-mln-to-lg-display-for-oled-investment-electronic-times.html

http://www.trustedreviews.com/opinions/hdr-tv-high-dynamic-television-explained

https://en.wikipedia.org/wiki/Ultra-high-definition_television#Americas

Whatcha talkin’ bout? FOO! Setting up proper fail over in a Cluster.

Here is what a 2 node fail over cluster should look like. Double network redundancy on the back end with each node and the SAN connecting to both back end switches.

selection_046

In order to setup proper cluster fail over the Server needs to be set to Fail Over Only (FOO). Remember that Windows has iSCSI volume size restrictions. So when you create volumes and LUNs on you SAN you need to limit the size. See link at end of article.

To do this you need a couple things, first you need to connect the iSCSI connection to both servers. Some SAN manufacturers have their own DMS drivers, which are usually a modified version of the Microsoft DSM driver. HP actually recommends using the Microsoft DSM.

The proper DSM is required in order to setup proper MPIO (Multipath Input and Output) on a cluster.

In short MPIO, is the multipath interconnect necessary for failover, it uses the DSM driver to achieve this. Generally the DSM driver is provided by the OS vendor, in this case Microsoft. This is also the HP recommended method of connecting to the SAN from Microsoft Windows, and most other manufacturers also use the Microsoft DSM driver.

Map iSCSI connections

First we need to properly map the iSCSI connections. Be aware that you will be mapping the same connection multiple times, this is necessary for failover. In the above example each server has 4 connections. 2 for the 20 subnet and 2 for the 30 subnet. Open up iSCSI Initiator and select the Discovery tab.

In the discovery tab add all 4 IP destinations, x.x.20.110, x.x.30.110, x.x.20.111, x.x.30.111.

Click the Discover Portal… button and add each one of those connections.

Next select the Targets tab, you should see the inactive iSCSI connection here.

Highlight the connection and click Connect. The HP SAN is setup with a single iSCSI connector and multiple LUNs. Some devices have multiple iSCSI connectors with a single LUN on each. Depending on the setup you might have to do this to each connector.

A Connect To Target window will pop up, check off Enable multi-path and click Advanced.

Under Local adapter select Microsoft iSCSI Initiator, for the Initiator IP select the IP for the Server, and the Target Portal IP should be one of the two IPs on the same subnet as the Initiator IP. It should look like the following.

selection_047

Now repeat these steps, highlight the same connection, click Connect, check of Enable multi-path, click Advanced…, rinse and repeat, this will map the other three connections.

10.10.20.4 -> 10.10.20.111, 10.10.30.6 ->  10.10.30.110, 10.10.30.6 -> 10.10.30.111.

If you click the Favourite targets tab you should see 4 similar targets. These are all the connections you just created for the one iSCSI target(iqn).

Set up Connection Fail Over

Next start the MPIO applet, Start > Run > mpiocpl your Vendor should be listed in the Devices: window. If it is not you will need to add it via the Discover Multi-Paths tab, others window. Highlight the Device Hardware and click Add. Say no to the reboot.  

selection_048

Next in the SPC-3 compliant window check off Add support for iSCSI devices and click Add. You will again be prompted to reboot. This time do so.

selection_049

If you run the command mpclaim -s -d in an admin CMD session you should see the connection now.

selection_050

Back in the iSCSC Initiator applet, if you highlight the iqn connection on the Targets tab and click Properties, Devices, and MPIO, you should see the Load Balance policy and all the paths that this connection can fail over to.

Your load balance policy will initially default to Round Robin change this to Fail Over Only. If you do this all but one connection should set to Active, all others will go into Standby. Click Apply.

Don’t worry if the connections don’t go into standby, just make sure that FOO is applied. Sometimes with multiple mapped disks this can happen.

selection_051

Now is you run the same mpclaim command your LB Policy should be changed to FOO (Fail Over Only). You will need to do this for each mapped disk.

selection_052

To change the Load Balancing policy to FOO run mpclaim with the -L and -M switch.

mpclaim.exe -L -M 1

The one at the end is indicative of a FOO LB policy, if a connection fails it will immediately fail over to the next one. This is for always on high demand systems.

Now if you run the -s -d switches you should see FOO under the LB policy.

selection_053

Now go into Control Panel > Administrative Tools > Computer Management and bring the iSCSI disk online and format them to NTFS. I had an instance where the disk wouldn’t come online even when I brought it online. If this is the case resize your LUN disks, they are too large.

Mpclaim determines the policy for the iSCSI connection. For more information on mpclaim go to Microsoft’s website and user the following reference https://technet.microsoft.com/en-us/library/ee619743(v=ws.10).aspx

https://technet.microsoft.com/en-us/library/dd851699(v=ws.11).aspx

iSCSI and VHD/VHDX volume size restrictions.

The age of telemetry and online tracking.

Telemetry has been around for a while, Windows 7 had it, and I believe even Vista might have had it.

Having said this Microsoft did not previously sell this information to third parties not did it previously include personal information. When I say personal information I mean your age gender, approximate location, and online habits. Legally they can not give your name, address, and other details that would allow someone to pin point you in real life. So instead they are selling as much as they can about you without actually telling them who you really are. Mind you Micrrosoft is not the only company that uses telemetry data, recently Nvidia got caught with their hand in the cookie jar as well. Scary, right?

Windows:

Fret not where there is a will there is a way. If like me you spend a lot of time connected to the online world there should be a few applications that you need to explore.

For Windows 10 there are a couple of Telemetry applications that you can install that will kill the services and registry entries that allow Windows to send your data to big brother.

O&O Software has an Antispy-Tool for Windows 10. This is a free download. It’s called O&O ShutUp10. With this tool you can pick and choose in great detail what you want to block and what you want to allow.

03

The folks over at Safer Networking that brought us Spybot Search and Destroy have also built a similar tool. They call their Telemetry removal tool Spybot Anti-Beacon, the link can be found on their download page. This has a portable version so you can run it off a flash drive if you need to.

capture

The first time you run this it will show you what you have blocked and what is still tracking you. If you click the “Show Options” button it will show you the registry keys that will be changed. Click Immunize and restart your computer.

Besides these tools, I have also edited my hosts file and added a bunch of domain names that direct to 0.0.0.0, essentially to nowhere. Spybot also adds a couple hosts entries into the file.

0.0.0.0 a.ads1.msn.com
0.0.0.0 a.ads2.msads.net
0.0.0.0 a.ads2.msn.com
0.0.0.0 a.rad.msn.com
0.0.0.0 a-0001.a-msedge.net
0.0.0.0 a-0002.a-msedge.net
0.0.0.0 a-0003.a-msedge.net
0.0.0.0 a-0004.a-msedge.net
0.0.0.0 a-0005.a-msedge.net
0.0.0.0 a-0006.a-msedge.net
0.0.0.0 a-0007.a-msedge.net
0.0.0.0 a-0008.a-msedge.net
0.0.0.0 a-0009.a-msedge.net
0.0.0.0 ac3.msn.com
0.0.0.0 ad.doubleclick.net
0.0.0.0 adnexus.net
0.0.0.0 adnxs.com
0.0.0.0 ads.msn.com
0.0.0.0 ads1.msads.net
0.0.0.0 ads1.msn.com
0.0.0.0 aidps.atdmt.com
0.0.0.0 aka-cdn-ns.adtech.de
0.0.0.0 a-msedge.net
0.0.0.0 az361816.vo.msecnd.net
0.0.0.0 az512334.vo.msecnd.net
0.0.0.0 b.ads1.msn.com
0.0.0.0 b.ads2.msads.net
0.0.0.0 b.rad.msn.com
0.0.0.0 bs.serving-sys.com
0.0.0.0 c.atdmt.com
0.0.0.0 c.msn.com
0.0.0.0 cdn.atdmt.com
0.0.0.0 cds26.ams9.msecn.net
0.0.0.0 choice.microsoft.com
0.0.0.0 choice.microsoft.com.nsatc.net
0.0.0.0 compatexchange.cloudapp.net
0.0.0.0 corp.sts.microsoft.com
0.0.0.0 corpext.msitadfs.glbdns2.microsoft.com
0.0.0.0 cs1.wpc.v0cdn.net
0.0.0.0 db3aqu.atdmt.com
0.0.0.0 df.telemetry.microsoft.com
0.0.0.0 diagnostics.support.microsoft.com
0.0.0.0 ec.atdmt.com
0.0.0.0 feedback.microsoft-hohm.com
0.0.0.0 feedback.search.microsoft.com
0.0.0.0 feedback.windows.com
0.0.0.0 flex.msn.com
0.0.0.0 g.msn.com
0.0.0.0 h1.msn.com
0.0.0.0 i1.services.social.microsoft.com
0.0.0.0 i1.services.social.microsoft.com.nsatc.net
0.0.0.0 lb1.www.ms.akadns.net
0.0.0.0 live.rads.msn.com
0.0.0.0 m.adnxs.com
0.0.0.0 msedge.net
0.0.0.0 msftncsi.com
0.0.0.0 msnbot-65-55-108-23.search.msn.com
0.0.0.0 msntest.serving-sys.com
0.0.0.0 oca.telemetry.microsoft.com
0.0.0.0 oca.telemetry.microsoft.com.nsatc.net
0.0.0.0 pre.footprintpredict.com
0.0.0.0 preview.msn.com
0.0.0.0 rad.live.com
0.0.0.0 rad.msn.com
0.0.0.0 redir.metaservices.microsoft.com
0.0.0.0 schemas.microsoft.akadns.net
0.0.0.0 secure.adnxs.com
0.0.0.0 secure.flashtalking.com
0.0.0.0 settings-sandbox.data.microsoft.com
0.0.0.0 settings-win.data.microsoft.com
0.0.0.0 sls.update.microsoft.com.akadns.net
0.0.0.0 sqm.df.telemetry.microsoft.com
0.0.0.0 sqm.telemetry.microsoft.com
0.0.0.0 sqm.telemetry.microsoft.com.nsatc.net
0.0.0.0 ssw.live.com
0.0.0.0 static.2mdn.net
0.0.0.0 statsfe1.ws.microsoft.com
0.0.0.0 statsfe2.ws.microsoft.com
0.0.0.0 telecommand.telemetry.microsoft.com
0.0.0.0 telecommand.telemetry.microsoft.com.nsatc.net
0.0.0.0 telemetry.appex.bing.net
0.0.0.0 telemetry.microsoft.com
0.0.0.0 telemetry.urs.microsoft.com
0.0.0.0 vortex.data.microsoft.com
0.0.0.0 vortex-bn2.metron.live.com.nsatc.net
0.0.0.0 vortex-cy2.metron.live.com.nsatc.net
0.0.0.0 vortex-sandbox.data.microsoft.com
0.0.0.0 vortex-win.data.microsoft.com
0.0.0.0 watson.live.com
0.0.0.0 http://www.msftncsi.com
0.0.0.0 apps.skype.com
0.0.0.0 fe2.update.microsoft.com.akadns.net
0.0.0.0 m.hotmail.com
0.0.0.0 pricelist.skype.com
0.0.0.0 reports.wes.df.telemetry.microsoft.com
0.0.0.0 s.gateway.messenger.live.com
0.0.0.0 s0.2mdn.net
0.0.0.0 services.wes.df.telemetry.microsoft.com
0.0.0.0 statsfe2.update.microsoft.com.akadns.net
0.0.0.0 survey.watson.microsoft.com
0.0.0.0 ui.skype.com
0.0.0.0 view.atdmt.com
0.0.0.0 watson.microsoft.com
0.0.0.0 watson.ppe.telemetry.microsoft.com
0.0.0.0 watson.telemetry.microsoft.com
0.0.0.0 watson.telemetry.microsoft.com.nsatc.net
0.0.0.0 wes.df.telemetry.microsoft.com

*Note not all of the above addresses belong to Microsoft. Most of those URLs preform some sort of tracking so probably a good idea to block them anyways.

Nvidia:

Recently it has been discovered that Nvidia included Telemetry in their driver software. Some believe it is only part of the GForce experience, but that is not the case, it is installed along side the driver.

In order to disable the Telemetry bundled with the Nvidia driver you need to download Autoruns from Sysinternals. Extract the package and run the executable as Administrator. Make sure the everything tab is selected and filter content with the keyword: nvidia. Then proceed to uncheck the following items and then just close the application, followed by a reboot.

capture2

Now Nvidia might not be tracking anything, but that is not the point. Also you will need to do this every time you reinstall the driver.

Web browser:

To hide yourself online, obviously the best technology is a VPN or a proxy server. However these can cost quite a bit of money.

My suggestion is use two of the better online extensions. Electronic Frontier Foundations Privacy badger and uBlockOrigin.

Privacy Badger can be installed right from the eff.org web page. To install uBlickOrigin go to your web browsers extension store to find plugin and install it. For Vivaldi go to the chrome store as it is based on Chromium and all chrome extensions are compatible with it.

Home Media – Part 3 – The Rip

It’s been a while but finally I got around to completing Part 3 of an old series.

Part 1: The NAS build, can be found here. 

Part 2: The Setup can be found here.

Part 4: OSMC/KODI/XBMC can be found here.

The whole idea of this was so you could have your media at your finger tips. Your movies, your TV shows and your Music. If you’re like me you have shelves and shelves full of Movies and Television shows, and plastic bins full of CDs.

I’m not condoning piracy, and personally I think you should have control over the media that you own, as long as you don’t distribute it or broadcast it for the masses. Having said this you should probably check with your Country’s copyright laws. Either way it is nice to have it all at your finger tips.

I’m finding less and less compatibility between software and HD DVD movies these days, some titles I am unable to convert into a digital format form HD DVD. Also there is a draw back with HD DVDs, they only support Dolby Digital and DTS audio, where as newer Blu-Ray movies support lossless audio such as Dolby True HD and DTS Master Audio formats. There are a few new ones on the horizon as well, these would be Dolby Atmos, DTS:X and, Auro-3D.

Couple of good sites where you can find a lot of information on ripping and appending videos are http://www.videohelp.com/ and http://www.doom9.org/ .

To rip movies/tv you will require a few pieces of software. Besides the necessary codecs only two, Make MKV and Handbrake. Make MKV strips the copy protection and rips 1:1 video and puts them in MKV containers. Handbrake compresses the videos to specific formats and output devices. These are both free, if you want to pay for a single piece of software I would recommend DVDFab Blu-Ray ripper.

K-Lite Codec Pack is used to decode the material and the different formats for converting the material you will be ripping.

Capture5

MakeMKV can be used to strip the AACS and BD+ protections from discs, however this software goes a step further and can also convert your Blu-Ray movie to a MKV container. Mind you the movie will be large and there will be no compression, so the files can turn out to be 20GB, great if you want a lossless 1:1 copy of your movies. This software is free while in beta and for full functionality. You must input their beta key in to the software to make if functional, the key can be found here on their forum. This software also allows you to rip 3D Blu-Ray Titles. You can actually get away using only this software for ripping content.

Capture

HandBrake requires you to have the disc already ripped and stripped, generally using MakeMKV or Fab Decrypter. I really like using the batch processing mode in HandBrake, it’s very useful for TV shows. Also with handbrake you can create a custom template so it’s nice and easy to work with TV shows or repetitive content. HandBrake is also a converter so it can convert content for portable devices, it can make the file sizes smaller and change the resolution of the source, etc.

Capture4

DVDFab HD Decrypter is used to copy movies into a file and remove the encryption on the disc. This will remove AACS and BD+ protection. This software is free and usually the first step to digitizing your library, uless you are using MakeMKV. Be aware though, some software is not able to create Rips from these backups there is something specific to this software that sometimes does not play well with other applications.

DVDFab Blu-Ray Ripper (3D Plus), I use this software to rip my 3D Bly-Rays. This software allows the movies to be ripped into a 3D half side by side MKV or a 3D half over under MKV file. It’s paid software, but worth the money. Having said this there are other options for ripping 3D movies, MakeMKV can do it as well. Nice thing about this application is that you can compress the file and there is no need for a 1:1 copy.

Pavtube ByteCopy, I’ve actually never used this software but in my research I found that people have good things to say about the software.

BDtoAVCHD is another tool that came to my attention recently, If you ever want to create discs from your ripped content this is the tool to use.

So now that you have the necessary software where do you go from here?

Note that if you are looking for menus etc, this is not the guide for you. I don’t really care for the extra content and only want Audio track/Subtitle options. Mind you with Make MKV you are able to rip the special content as well, but I reiterate there is no menu system. Also I will only cover the Make MKV how to here, the DVDFab method is a paid method and kind of an all in one package that is simple to use, so no need to get into the details of that.

Download, install, and get the beta Make MKV key from the forum. The key changes with each Beta release, and even though MakeMKV is in version 1.x it is still free/considered beta.

Capture2

Once you install the software start up Make MKV and input the key in Help > Register. If you like the software and want to purchase it go to Help > Purchase. Untitled5

Insert the disc with the material you want to rip, make sure you have the right optical drive selected in the drop down list, then press the Open Disc icon in the left pane of the application window. The icon looks like a DVD drive with a disc inside. Alternatively you can go to File > Open Disc and select the appropriate optical drive where your disc is. Untitled2

 

The icon will start to look like it’s spinning and the software will take a minute to read and decrypt the disc in the drive. Once this process completes you will be presented with a list of valid Video sources on the disc. Generally the large ones are the content that you want.

Untitled3

Note that with this particular disc you have 4 episodes/Titles and that the 5th 7.0GB file is all of the episodes in one seamless Title. When I was converting this I generally skipped this one Title. Select the titles you wish to rip. Change the output folder on the right side of the window to where you want to save the converted files to. Then click the Make MKV button to the right of that. Depending on the processing prowess of your PC this can take a bit, it will also prompt you to create the folder if it does not exist. Untitled6

Once the process completes go into the folder and rename the files to something meaningful.

Once you have your MKV, you can start to compress and convert the formats.

To do this use Handbrake, it has several presets available for you to use. However if you wish you can create  your own and save it. This is where you can take 1080p content and convert it to 720p, having said this this will take a long time if you have a slower computer.

handbrake

You select your source which is either a file or a folder, and you can set your resolution in the Picture tab. Notice the output settings, you can change them to MKV or MP4 in this example. This is something to keep in mind.

handbrake2

In the Video tab you can change the codec that the encoder will use to recode your video in, H.265 is an option, select the Quality and you can even do 2-Pass Encoding. While 2-Pass encoding does improve the quality you will be looking at a really long encode unless you have lots of RAM and a really fast processor.

handbrake3

Then you have your Audio section where you can downmix to stereo or upmix to a different codec all together. Note that you can have multiple audio tracks.

Once you have selected your desired settings you can save them as to use at a later time, just click the ADD button on the bottom right. If you have multiple videos to encode add them to the queue and keep going, nice thing about Handbrake is that it does batch conversions.