ujh- ddlZddlmZddlmZmZmZddlmZddl m Z ddl m Z ddl mZmZdZd gd gd d d ddddZdZdZdefdZdedededeefdZdedefdZdedefdZGdde ZGd d!eZGd"d#eZy)$N)Path)ListTupleUnion)Tensor)Dataset)download_url_to_file) _extract_zip_load_waveformi>zvox1_dev_wav.zip)zIhttps://thor.robots.ox.ac.uk/~vgg/data/voxceleb/vox1a/vox1_dev_wav_partaazIhttps://thor.robots.ox.ac.uk/~vgg/data/voxceleb/vox1a/vox1_dev_wav_partabzIhttps://thor.robots.ox.ac.uk/~vgg/data/voxceleb/vox1a/vox1_dev_wav_partaczIhttps://thor.robots.ox.ac.uk/~vgg/data/voxceleb/vox1a/vox1_dev_wav_partad)@21ec6ca843659ebc2fdbe04b530baa4f191ad4b0971912672d92c158f32226a0@311d21e0c8cbf33573a4fce6c80e5a279d80736274b381c394319fc557159a04@92b64465f2b2a3dc0e4196ae8dd6828cbe9ddd1f089419a11e4cbfe2e1750df0@00e6190c770b27f27d2a3dd26ee15596b17066b715ac111906861a7d09a211a5) archive_nameurls checksumszvox1_test_wav.zipzGhttps://thor.robots.ox.ac.uk/~vgg/data/voxceleb/vox1a/vox1_test_wav.zip@8de57f347fe22b2c24526e9f444f689ecf5096fc2a92018cf420ff6b5b15eaea)rurlchecksumdevtestzBhttps://www.robots.ox.ac.uk/~vgg/data/voxceleb/meta/iden_split.txtzAhttps://www.robots.ox.ac.uk/~vgg/data/voxceleb/meta/veri_test.txtrootc dD]'}t|d}tjj||}|dk(rt|d}t|d}t |d5}t ||D]\}}tjj|tjj |} t|| |t | d5} |j| jddd dddn&t|d }t|d }t|||t|*y#1swYxYw#1swY$xYw) Nrrrrrwb) hash_prefixrbrr) _ARCHIVE_CONFIGSospathjoinopenzipbasenamer writereadr ) rarchiver archive_pathrrfrr file_pathf_splits [/var/www/html/dev/engine/venv/lib/python3.12/site-packages/torchaudio/datasets/voxceleb1.py_download_extract_wavsr-&s7"#'0@ ww||D,7  e #G,V4D(1+>IlD) 0Q%(y%90MC " T2773C3CC3H II(iXNi.0' /000 0 0#7+E2C'0<s F  5 i $ $Dzz|HB2w% d# $$ &> $ &>s'A0 A00Bveri_test_pathcg}t|d5}|D]*}|j\}}}|j|||f, ddd|S#1swY|SxYw)Nr5)r"r6r8)rr?r:r)r<labelpath1path2s r,_get_paired_flistrDLse F nc "1a 1D"&**, E5% MM5%/ 0 11 M 1 Ms 0A  A _ext_audioc|jddd\}}}|j|d}dj|||g}|S)N/-)r6replacer!)r*rE speaker_id youtube_id utterance_idfile_ids r, _get_file_idrPUsJ+4??3+?+D(J L'' B7Lhh J =>G NcXeZdZdZdZd deeefdeddfdZ de fd Z de fd Z de fd Z y) VoxCeleb1a"*VoxCeleb1* :cite:`nagrani2017voxceleb` dataset. Args: root (str or Path): Path to the directory where the dataset is found or downloaded. download (bool, optional): Whether to download the dataset if it is not found at root path. (Default: ``False``). z.wavrdownloadr/Nctj|}tjj|d|_tjj |js'|st d|jdt|yy)NwavzDataset not found at z5. Please set `download=True` to download the dataset.)rfspathr r!_pathisdir RuntimeErrorr-)selfrrTs r,__init__zVoxCeleb1.__init__gsiyyWW\\$. ww}}TZZ("+DJJ<7lm #4 ( )rQnctNNotImplementedErrorr[r]s r, get_metadatazVoxCeleb1.get_metadatar!!rQctr_r`rbs r, __getitem__zVoxCeleb1.__getitem__urdrQctr_r`r[s r,__len__zVoxCeleb1.__len__xrdrQ)F)__name__ __module__ __qualname____doc__rErstrrboolr\r7rcrfrirQr,rSrS\sUJ )U39- ) )$ )"c""S"""rQrSc eZdZdZdedfdeeefdedededd f fd Z d e de ee e effd Z d e de e e e effd Zde fdZxZS)VoxCeleb1Identificationu*VoxCeleb1* :cite:`nagrani2017voxceleb` dataset for speaker identification task. Each data sample contains the waveform, sample rate, speaker id, and the file id. Args: root (str or Path): Path to the directory where the dataset is found or downloaded. subset (str, optional): Subset of the dataset to use. Options: ["train", "dev", "test"]. (Default: ``"train"``) meta_url (str, optional): The url of meta file that contains the list of subset labels and file paths. The format of each row is ``subset file_path". For example: ``1 id10006/nLEBBc9oIFs/00003.wav``. ``1``, ``2``, ``3`` mean ``train``, ``dev``, and ``test`` subest, respectively. (Default: ``"https://www.robots.ox.ac.uk/~vgg/data/voxceleb/meta/iden_split.txt"``) download (bool, optional): Whether to download the dataset if it is not found at root path. (Default: ``False``). Note: The file structure of `VoxCeleb1Identification` dataset is as follows: └─ root/ └─ wav/ └─ speaker_id folders Users who pre-downloaded the ``"vox1_dev_wav.zip"`` and ``"vox1_test_wav.zip"`` files need to move the extracted files into the same ``root`` directory. r1Frr.meta_urlrTr/NcLt||||dvr tdtjj |tjj |}tjj|s t||t|j|||_ y)N)r1rrz0`subset` must be one of ['train', 'dev', 'test']) superr\ ValueErrorrr r!r$existsr r>rX_flist)r[rr.rsrTmeta_list_path __class__s r,r\z VoxCeleb1Identification.__init__sz x( 1 1OP PdBGG,<, : ^VD rQr]c|j|}t||j}|jdd}t |dd}|t ||fS)aGet metadata for the n-th sample from the dataset. Returns filepath instead of waveform, but otherwise returns the same fields as :py:func:`__getitem__`. Args: n (int): The index of the sample Returns: Tuple of the following items; str: Path to audio int: Sample rate int: Speaker ID str: File ID rJrr4N)rxrPrEr6r7 SAMPLE_RATE)r[r]r*rOrLs r,rcz$VoxCeleb1Identification.get_metadatasS&KKN y$//:]]3'* AB( +z7::rQcp|j|}t|j|d|d}|f|ddzS)adLoad the n-th sample from the dataset. Args: n (int): The index of the sample to be loaded Returns: Tuple of the following items; Tensor: Waveform int: Sample rate int: Speaker ID str: File ID rr2Nrcr rX)r[r]metadatawaveforms r,rfz#VoxCeleb1Identification.__getitem__sA$$$Q'!$**hqk8A;G{Xab\))rQc,t|jSr_lenrxrhs r,rizVoxCeleb1Identification.__len__4;;rQ)rjrkrlrm_IDEN_SPLIT_URLrrnrror\r7rrcrrfri __classcell__rzs@r,rrrr|s85<_ot E#t)$ E.1 EGJ Ehl E  E;c;eCc3,>&?;2*S*U63S+@%A*,  rQrrc eZdZdZedfdeeefdededdffd Z d e de eee e eeffd Z d e de e e e e eeffd Zde fd ZxZS) VoxCeleb1Verificationu*VoxCeleb1* :cite:`nagrani2017voxceleb` dataset for speaker verification task. Each data sample contains a pair of waveforms, sample rate, the label indicating if they are from the same speaker, and the file ids. Args: root (str or Path): Path to the directory where the dataset is found or downloaded. meta_url (str, optional): The url of meta file that contains a list of utterance pairs and the corresponding labels. The format of each row is ``label file_path1 file_path2". For example: ``1 id10270/x6uYqmx31kE/00001.wav id10270/8jEAjG6SegY/00008.wav``. ``1`` means the two utterances are from the same speaker, ``0`` means not. (Default: ``"https://www.robots.ox.ac.uk/~vgg/data/voxceleb/meta/veri_test.txt"``) download (bool, optional): Whether to download the dataset if it is not found at root path. (Default: ``False``). Note: The file structure of `VoxCeleb1Verification` dataset is as follows: └─ root/ └─ wav/ └─ speaker_id folders Users who pre-downloaded the ``"vox1_dev_wav.zip"`` and ``"vox1_test_wav.zip"`` files need to move the extracted files into the same ``root`` directory. FrrsrTr/Nc,t|||tjj |tjj |}tjj |s t||t|j||_ yr_) rur\rr r!r$rwr rDrXrx)r[rrsrTryrzs r,r\zVoxCeleb1Verification.__init__sa x(dBGG,<, :' NC rQr]c|j|\}}}t|}t||j}t||j}||t|||fS)agGet metadata for the n-th sample from the dataset. Returns filepaths instead of waveforms, but otherwise returns the same fields as :py:func:`__getitem__`. Args: n (int): The index of the sample Returns: Tuple of the following items; str: Path to audio file of speaker 1 str: Path to audio file of speaker 2 int: Sample rate int: Label str: File ID of speaker 1 str: File ID of speaker 2 )rxr7rPrEr|)r[r]rAfile_path_spk1file_path_spk2 file_id_spk1 file_id_spk2s r,rcz"VoxCeleb1Verification.get_metadatasU.15 A-~~E #NDOOD #NDOOD ~{ErDrPrSrrrrprQr,rs %%$5B +    ,XV !,WT##, S S # $s)  CCS""@X iX v^ I^ rQ