X5: best way to batch convert DV1 files for archiving?
Moderator: Ken Berry
-
SanderP
- Posts: 10
- Joined: Fri Oct 05, 2012 4:02 am
- System_Drive: C
- 32bit or 64bit: 64 Bit
- motherboard: MSI X58
- processor: i7-920
- ram: 12GB
- Video Card: GTX-260
- sound_card: Built in
- Hard_Drive_Capacity: 5TB
- Monitor/Display Make & Model: Asus 1080p
X5: best way to batch convert DV1 files for archiving?
Hi,
I've been re-downloading my old Mini DV tapes. I have close to 30 of them so that's a considerable amount of data. I would like to do a reasonable (up for discussion of course) compression of the DV files before sticking them on my NAS box for all eternity (mirrored storage and backed up off-site).
I tried to use the batch conversion tool with several codecs and it generally works but I can't find a combination of codec and settings that leaves the video at the original 720x480 resolution and aspect ratio. When I pick, say, mp4 or m2t formats and 480p resolution I get 720x480 video but there are letterbox bars on the left and right. I do select the 4:3 aspect ratio.
What are the right settings for this task? I can figure out the right compromise for bitrate but I want 720x480 native resolution, no scaling. If I shouldn't use this tool for the job but something else, let me know please.
Batch convert is discussed a few times on this forum and even related to the gratuitous letter boxing it adds but the issue wasn't resolved so I figured I'd frame it as a 'best practices' question.
Thanks,
Sander
I've been re-downloading my old Mini DV tapes. I have close to 30 of them so that's a considerable amount of data. I would like to do a reasonable (up for discussion of course) compression of the DV files before sticking them on my NAS box for all eternity (mirrored storage and backed up off-site).
I tried to use the batch conversion tool with several codecs and it generally works but I can't find a combination of codec and settings that leaves the video at the original 720x480 resolution and aspect ratio. When I pick, say, mp4 or m2t formats and 480p resolution I get 720x480 video but there are letterbox bars on the left and right. I do select the 4:3 aspect ratio.
What are the right settings for this task? I can figure out the right compromise for bitrate but I want 720x480 native resolution, no scaling. If I shouldn't use this tool for the job but something else, let me know please.
Batch convert is discussed a few times on this forum and even related to the gratuitous letter boxing it adds but the issue wasn't resolved so I figured I'd frame it as a 'best practices' question.
Thanks,
Sander
- lata
- Site Admin
- Posts: 14280
- Joined: Thu Jan 19, 2012 6:21 am
- System_Drive: C
- 32bit or 64bit: 64 Bit
- motherboard: ASUSTeK COMPUTER INC A88XM-A USB 3 1 Rev X 0x
- processor: 4 10 gigahertz AMD A10-7890K Radeon R7
- ram: 16 gb
- Video Card: on board
- sound_card: Realtek High Definition Audio
- Hard_Drive_Capacity: 500 SSD
- Monitor/Display Make & Model: LG W2242 [Monitor]
- Corel programs: CVSX, 19, 20, 22 PSP2023, PI, MS3D
- Location: UK
- Contact:
Re: X5: best way to batch convert DV1 files for archiving?
Hi
A couple of things to consider.
DV-Avi is generally interlaced using Lower Field, Changing the interlacing to Upper Field will probably show as a sawtooth effect.
Video Studios default Mpeg2 and MTS templates use Upper Field bringing the program in line with HD video types, Unfortunate for older DV-Avi.
Use the Custom option or Make Movie Templates Manager to create your own template.
-------------------------
DV-Avi video is anamorphic, 720 x 480 is not actually 4:3 although it displays as 4:3.
In the same way that 720 x 480 can display as 16:9.
If you create MP4 video (not anamorphic) to 720 x 480 it will probably use a black border to fill the space, you should modify the frame size to 720 x 540 which is 4 x 3
Creating a Mpeg2 or MTS file should be ok at 720 x 480, and indeed display as 4:3
--------------------------
What video format do you wish to use to convert the DV-Avi video files?
Mpeg2, Mts, Mp4, Quicktime
If in the future you wished to burn a DVD then you should be considering the Mpeg or Mts options?
Once you have decided on a format and video properties, using Batch Convert should be easy.
A couple of things to consider.
DV-Avi is generally interlaced using Lower Field, Changing the interlacing to Upper Field will probably show as a sawtooth effect.
Video Studios default Mpeg2 and MTS templates use Upper Field bringing the program in line with HD video types, Unfortunate for older DV-Avi.
Use the Custom option or Make Movie Templates Manager to create your own template.
-------------------------
DV-Avi video is anamorphic, 720 x 480 is not actually 4:3 although it displays as 4:3.
In the same way that 720 x 480 can display as 16:9.
If you create MP4 video (not anamorphic) to 720 x 480 it will probably use a black border to fill the space, you should modify the frame size to 720 x 540 which is 4 x 3
Creating a Mpeg2 or MTS file should be ok at 720 x 480, and indeed display as 4:3
--------------------------
What video format do you wish to use to convert the DV-Avi video files?
Mpeg2, Mts, Mp4, Quicktime
If in the future you wished to burn a DVD then you should be considering the Mpeg or Mts options?
Once you have decided on a format and video properties, using Batch Convert should be easy.
-
SanderP
- Posts: 10
- Joined: Fri Oct 05, 2012 4:02 am
- System_Drive: C
- 32bit or 64bit: 64 Bit
- motherboard: MSI X58
- processor: i7-920
- ram: 12GB
- Video Card: GTX-260
- sound_card: Built in
- Hard_Drive_Capacity: 5TB
- Monitor/Display Make & Model: Asus 1080p
Re: X5: best way to batch convert DV1 files for archiving?
Hi Trevor,
thanks for your informative answer, I appreciate you taking the time.
Most of my DV content was recorded in progressive scan because I intended to display the result on the computer rather than TV. That said I will most likely have recorded some in interlaced format so I'll have to make sure to take that into consideration.
I have created custom templates already so no problem there. I should have done the math on 720x480 and 4:3, thanks for pointing out that there is a good reason to add those bars. I will experiment some more and let you know what I ended up using. I'm pretty much format agnostic but it seems to make sense to use the best compression I have and allocate generous bandwidth so that my backup is a reasonably facsimile of the original.
Best,
Sander
thanks for your informative answer, I appreciate you taking the time.
Most of my DV content was recorded in progressive scan because I intended to display the result on the computer rather than TV. That said I will most likely have recorded some in interlaced format so I'll have to make sure to take that into consideration.
I have created custom templates already so no problem there. I should have done the math on 720x480 and 4:3, thanks for pointing out that there is a good reason to add those bars. I will experiment some more and let you know what I ended up using. I'm pretty much format agnostic but it seems to make sense to use the best compression I have and allocate generous bandwidth so that my backup is a reasonably facsimile of the original.
Best,
Sander
-
canuck
- Posts: 2037
- Joined: Wed Mar 14, 2012 3:28 pm
- System_Drive: C
- 32bit or 64bit: 64 Bit
- Location: Deep River, Ontario, Canada
Re: X5: best way to batch convert DV1 files for archiving?
Since you are capturing in DV avi that will be the best format you can ever get. "Upgrading" to so-called higher formats does not really improve the quality of the video and in fact sometimes magnifies the "imperfections" in your recording. If you have the available storage space then I would save the video in the DVD avi format you captured it in and so there would be no need to do any compression at all.
As a rule of thumb for 60 minutes of DV avi video you need about 13-14GB.
As a rule of thumb for 60 minutes of DV avi video you need about 13-14GB.
-
SanderP
- Posts: 10
- Joined: Fri Oct 05, 2012 4:02 am
- System_Drive: C
- 32bit or 64bit: 64 Bit
- motherboard: MSI X58
- processor: i7-920
- ram: 12GB
- Video Card: GTX-260
- sound_card: Built in
- Hard_Drive_Capacity: 5TB
- Monitor/Display Make & Model: Asus 1080p
Re: X5: best way to batch convert DV1 files for archiving?
Right, I need to pick the right codec and allow enough bandwidth. Hence the word 'reasonable' in my original post. I understand the original DV-1 avis are the best I'll ever get. Any processing will diminish them even if just a bit. I'm not sure what 'DVD avi' format is, perhaps a typo? Yes, I know it takes about 13GB of storage per tape. If there were no storage concerns I wouldn't have posted this. I -could- store it natively but I want to explore options. I was hoping someone had done this before and could offer an opinion.
One of the reasons I want to convert to mp4 or h264 is that it makes playback over wifi smoother. Even with such a mature codec as the DV Type 1 I still see stuttering on playback occasionally. If I play just that file from the disk it's fine but if something else is going on all bets are off. Since my wife will be exploring these videos from the NAS to her laptop I want that to be a somewhat pleasant experience. You can see on the right that my machine is much more powerful than is needed, that's not the problem. I suspect it's a result of how the codec buffers.
One of the reasons I want to convert to mp4 or h264 is that it makes playback over wifi smoother. Even with such a mature codec as the DV Type 1 I still see stuttering on playback occasionally. If I play just that file from the disk it's fine but if something else is going on all bets are off. Since my wife will be exploring these videos from the NAS to her laptop I want that to be a somewhat pleasant experience. You can see on the right that my machine is much more powerful than is needed, that's not the problem. I suspect it's a result of how the codec buffers.
-
canuck
- Posts: 2037
- Joined: Wed Mar 14, 2012 3:28 pm
- System_Drive: C
- 32bit or 64bit: 64 Bit
- Location: Deep River, Ontario, Canada
Re: X5: best way to batch convert DV1 files for archiving?
SanderP,
no the DV avi is not a typo but is the proper designation for the video on tape. There are 2 types under DV avi: type 1 and type 2.
FYI:
================================================
DV AVI
DV AVI (aka DV-AVI) is a type of AVI file where the video has been compressed to conform with DV standards. There are two types of DV-AVI files:
Type 1: The multiplexed Audio-Video is kept in its original multiplexing and saved together into the Video section of the AVI file
Does not waste much space (audio is saved uncompressed, but even uncompressed audio is tiny compared to the video part of DV), but Windows applications based on the VfW API do not support it.
Type 2: Like type 1, but audio is also saved as an additional audio stream into the file.
Supported by VfW applications, at the price of a small increase in file size.
Type 1 is actually the newer of the two types. Microsoft made the "type" designations, and decided to name their older VfW-compatible version "Type 2", which only furthered confusion about the two types. In the late 1990s through early 2000s, most professional-level DV software, including non-linear editing programs, only supported Type 1. One notable exception was Adobe Premiere, which only supported Type 2. High-end FireWire controllers usually captured to Type 1 only, while "consumer" level controllers usually captured to Type 2 only. Software is and was available for converting Type 1 AVIs to Type 2, and vice-versa, but this is a time-consuming process.
Many current FireWire controllers still only capture to one or the other type. However, almost all current DV software supports both Type 1 and Type 2 editing and rendering, including Adobe Premiere. Thus, many of today's users are unaware of the fact that there are two types of DV AVI files. In any event, the debate continues as to which – Type 1 or Type 2 – if either, is better.
===================================================
no the DV avi is not a typo but is the proper designation for the video on tape. There are 2 types under DV avi: type 1 and type 2.
FYI:
================================================
DV AVI
DV AVI (aka DV-AVI) is a type of AVI file where the video has been compressed to conform with DV standards. There are two types of DV-AVI files:
Type 1: The multiplexed Audio-Video is kept in its original multiplexing and saved together into the Video section of the AVI file
Does not waste much space (audio is saved uncompressed, but even uncompressed audio is tiny compared to the video part of DV), but Windows applications based on the VfW API do not support it.
Type 2: Like type 1, but audio is also saved as an additional audio stream into the file.
Supported by VfW applications, at the price of a small increase in file size.
Type 1 is actually the newer of the two types. Microsoft made the "type" designations, and decided to name their older VfW-compatible version "Type 2", which only furthered confusion about the two types. In the late 1990s through early 2000s, most professional-level DV software, including non-linear editing programs, only supported Type 1. One notable exception was Adobe Premiere, which only supported Type 2. High-end FireWire controllers usually captured to Type 1 only, while "consumer" level controllers usually captured to Type 2 only. Software is and was available for converting Type 1 AVIs to Type 2, and vice-versa, but this is a time-consuming process.
Many current FireWire controllers still only capture to one or the other type. However, almost all current DV software supports both Type 1 and Type 2 editing and rendering, including Adobe Premiere. Thus, many of today's users are unaware of the fact that there are two types of DV AVI files. In any event, the debate continues as to which – Type 1 or Type 2 – if either, is better.
===================================================
Last edited by canuck on Sat Oct 06, 2012 12:11 am, edited 1 time in total.
-
SanderP
- Posts: 10
- Joined: Fri Oct 05, 2012 4:02 am
- System_Drive: C
- 32bit or 64bit: 64 Bit
- motherboard: MSI X58
- processor: i7-920
- ram: 12GB
- Video Card: GTX-260
- sound_card: Built in
- Hard_Drive_Capacity: 5TB
- Monitor/Display Make & Model: Asus 1080p
Re: X5: best way to batch convert DV1 files for archiving?
Hi,
I appreciate you trying to help but I think there's a bit of misspelling and misquoting going on.
You wrote earlier: "If you have the available storage space then I would save the video in the DVD avi format you captured it in and so there would be no need to do any compression at all."
To which I replied: " I'm not sure what 'DVD avi' format is, perhaps a typo? "
Now you are telling me what the difference is between DV 1 and 2. Interesting but I didn't ask about that. I was trying to clarify what you had said earlier. I'll assume you meant to write DV avi in your original message and then misread my question.
Thank you.
Sander
I appreciate you trying to help but I think there's a bit of misspelling and misquoting going on.
You wrote earlier: "If you have the available storage space then I would save the video in the DVD avi format you captured it in and so there would be no need to do any compression at all."
To which I replied: " I'm not sure what 'DVD avi' format is, perhaps a typo? "
Now you are telling me what the difference is between DV 1 and 2. Interesting but I didn't ask about that. I was trying to clarify what you had said earlier. I'll assume you meant to write DV avi in your original message and then misread my question.
Thank you.
Sander
-
canuck
- Posts: 2037
- Joined: Wed Mar 14, 2012 3:28 pm
- System_Drive: C
- 32bit or 64bit: 64 Bit
- Location: Deep River, Ontario, Canada
Re: X5: best way to batch convert DV1 files for archiving?
Sorry Sander, yes of course I meant DV avi and not DVD avi. It did mention DV avi several and DVD avi only one (I think).
-
SanderP
- Posts: 10
- Joined: Fri Oct 05, 2012 4:02 am
- System_Drive: C
- 32bit or 64bit: 64 Bit
- motherboard: MSI X58
- processor: i7-920
- ram: 12GB
- Video Card: GTX-260
- sound_card: Built in
- Hard_Drive_Capacity: 5TB
- Monitor/Display Make & Model: Asus 1080p
Re: X5: best way to batch convert DV1 files for archiving?
No problem canuck, glad we got it worked out.
- lata
- Site Admin
- Posts: 14280
- Joined: Thu Jan 19, 2012 6:21 am
- System_Drive: C
- 32bit or 64bit: 64 Bit
- motherboard: ASUSTeK COMPUTER INC A88XM-A USB 3 1 Rev X 0x
- processor: 4 10 gigahertz AMD A10-7890K Radeon R7
- ram: 16 gb
- Video Card: on board
- sound_card: Realtek High Definition Audio
- Hard_Drive_Capacity: 500 SSD
- Monitor/Display Make & Model: LG W2242 [Monitor]
- Corel programs: CVSX, 19, 20, 22 PSP2023, PI, MS3D
- Location: UK
- Contact:
Re: X5: best way to batch convert DV1 files for archiving?
Hi SanderP
A couple of options to test out, compare file size, quality etc
You could also try Transport Stream or Mpeg2 DVD templates.
MPEG Transport-Stream Files
24 bits, 720 x 480, 29.97 fps
Lower Field First or Frame Based
(HDMV-NTSC), 4:3
H.264 Video
Video data rate: Variable (Max. 10653 kbps)
Audio data rate: 256 kbps
Dolby Digital Audio, 48 KHz, 2/0(L,R)
You can also try the Quicktime using Mpeg4
QuickTime Movie Files
24 bits, 720 x 540, 25 fps
Frame-based
MPEG 4 Visual
100% Quality, 1 Key Frame Rate
None, 8.000 KHz, 8 bits, Stereo
A couple of options to test out, compare file size, quality etc
You could also try Transport Stream or Mpeg2 DVD templates.
MPEG Transport-Stream Files
24 bits, 720 x 480, 29.97 fps
Lower Field First or Frame Based
(HDMV-NTSC), 4:3
H.264 Video
Video data rate: Variable (Max. 10653 kbps)
Audio data rate: 256 kbps
Dolby Digital Audio, 48 KHz, 2/0(L,R)
You can also try the Quicktime using Mpeg4
QuickTime Movie Files
24 bits, 720 x 540, 25 fps
Frame-based
MPEG 4 Visual
100% Quality, 1 Key Frame Rate
None, 8.000 KHz, 8 bits, Stereo
-
SanderP
- Posts: 10
- Joined: Fri Oct 05, 2012 4:02 am
- System_Drive: C
- 32bit or 64bit: 64 Bit
- motherboard: MSI X58
- processor: i7-920
- ram: 12GB
- Video Card: GTX-260
- sound_card: Built in
- Hard_Drive_Capacity: 5TB
- Monitor/Display Make & Model: Asus 1080p
Re: X5: best way to batch convert DV1 files for archiving?
Hi,
I ended up using MPEG Transport format:
MPEG Transport-Stream Files
24 bits, 720 x 480, 29.97 fps
Frame-based
(HDMV-NTSC), 4:3
H.264 Video
Video data rate: Variable (Max. 12000 kbps)
Audio data rate: 256 kbps
Dolby Digital Audio, 48 KHz, 2/0(L,R)
Space savings is about 2/3 (1.4 GB -> 549 MG), quality is acceptable. The problem is that X5 crashes after doing a few hundred conversions and it doesn't deal properly with filenames with multiple periods. So first I had to write a python script to rename all my files to be batch-convert-safe, but that was pretty easy. I then feared I'd have to write another script to figure out which files had been converted but it appears X5 actually converts in filename sort order so that makes that process a little easier.
Sure would be great if batch convert settings could be saved as a profile or were at least remembered between sessions. I suppose no one at Ulead/Corel expected this tool to be used in anger. Luckily transcode performance is quite acceptable.
Sander
I ended up using MPEG Transport format:
MPEG Transport-Stream Files
24 bits, 720 x 480, 29.97 fps
Frame-based
(HDMV-NTSC), 4:3
H.264 Video
Video data rate: Variable (Max. 12000 kbps)
Audio data rate: 256 kbps
Dolby Digital Audio, 48 KHz, 2/0(L,R)
Space savings is about 2/3 (1.4 GB -> 549 MG), quality is acceptable. The problem is that X5 crashes after doing a few hundred conversions and it doesn't deal properly with filenames with multiple periods. So first I had to write a python script to rename all my files to be batch-convert-safe, but that was pretty easy. I then feared I'd have to write another script to figure out which files had been converted but it appears X5 actually converts in filename sort order so that makes that process a little easier.
Sure would be great if batch convert settings could be saved as a profile or were at least remembered between sessions. I suppose no one at Ulead/Corel expected this tool to be used in anger. Luckily transcode performance is quite acceptable.
Sander
- lata
- Site Admin
- Posts: 14280
- Joined: Thu Jan 19, 2012 6:21 am
- System_Drive: C
- 32bit or 64bit: 64 Bit
- motherboard: ASUSTeK COMPUTER INC A88XM-A USB 3 1 Rev X 0x
- processor: 4 10 gigahertz AMD A10-7890K Radeon R7
- ram: 16 gb
- Video Card: on board
- sound_card: Realtek High Definition Audio
- Hard_Drive_Capacity: 500 SSD
- Monitor/Display Make & Model: LG W2242 [Monitor]
- Corel programs: CVSX, 19, 20, 22 PSP2023, PI, MS3D
- Location: UK
- Contact:
Re: X5: best way to batch convert DV1 files for archiving?
Hi
I have to admit that the option to save the settings via batch convert would be useful.
----------------------
If you were to convert to compliant Mpeg2 DVD rather than TS you would be able to set the project properties to match your video files properties.
Then doing Batch Convert --Save as Type -- Mpeg2 files would reflect the project properties.
Similar to:-
MPEG files
24 bits, 720 x 480, 29.97 fps
Frame-based
(DVD-NTSC), 4:3
Video data rate: 8000 kbps
Audio data rate: 256 kbps
Dolby Digital Audio, 48 KHz, 2/0(L,R)
I have to admit that the option to save the settings via batch convert would be useful.
----------------------
If you were to convert to compliant Mpeg2 DVD rather than TS you would be able to set the project properties to match your video files properties.
Then doing Batch Convert --Save as Type -- Mpeg2 files would reflect the project properties.
Similar to:-
MPEG files
24 bits, 720 x 480, 29.97 fps
Frame-based
(DVD-NTSC), 4:3
Video data rate: 8000 kbps
Audio data rate: 256 kbps
Dolby Digital Audio, 48 KHz, 2/0(L,R)
