Hugging Face's logo

Datasets:
matlok
/
python-audio-copilot-training-using-class-knowledge-graphs-2024-01-27

Tasks:
Text-to-Audio
Audio-to-Audio
Question Answering
Modalities:
Tabular
Text
Formats:
parquet
Sub-tasks:
parsing
Size:
< 1K
Tags:
python-copilot
python-coding
python-architecture
knowledge-graphs
multimodal
text-image-audio
Libraries:
Datasets
pandas
License:
Dataset card Viewer Files Community
Dataset Viewer
Auto-converted to Parquet
Full Screen
file_path
stringlengths
64
137
audio_path
stringlengths
75
150
recsize
int64
182k
11.3M
dbytes
unknown
dbytes_len
int64
182k
11.3M
audio_type
stringclasses
2 values
lang
stringclasses
1 value
file_path_len
int64
64
137
lang_len
int64
2
2
gen_mode
stringclasses
1 value
"transformers/src/transformers/models/data2vec/audio.class.configuration_data2vec_text.Data2VecTextO(...TRUNCATED)
"transformers/src/transformers/models/data2vec/audio.class.alp.question.configuration_data2vec_text.(...TRUNCATED)
200,679
"SUQzBAAAAAAAI1RTU0UAAAAPAAADTGF2ZjU4Ljc2LjEwMAAAAAAAAAAAAAAA//NYwAAAAAAAAAAAAEluZm8AAAAPAAAHPwADD0g(...TRUNCATED)
200,565
alp.question
en
112
2
audio.class
"transformers/src/transformers/models/data2vec/audio.class.configuration_data2vec_text.Data2VecTextO(...TRUNCATED)
"transformers/src/transformers/models/data2vec/audio.class.alp.answer.configuration_data2vec_text.Da(...TRUNCATED)
591,639
"SUQzBAAAAAAAI1RTU0UAAAAPAAADTGF2ZjU4Ljc2LjEwMAAAAAAAAAAAAAAA//NYwAAAAAAAAAAAAEluZm8AAAAPAAAVYwAJBng(...TRUNCATED)
591,525
alp.answer
en
112
2
audio.class
"transformers/src/transformers/models/data2vec/audio.class.configuration_data2vec_text.Data2VecTextC(...TRUNCATED)
"transformers/src/transformers/models/data2vec/audio.class.alp.question.configuration_data2vec_text.(...TRUNCATED)
198,839
"SUQzBAAAAAAAI1RTU0UAAAAPAAADTGF2ZjU4Ljc2LjEwMAAAAAAAAAAAAAAA//NYwAAAAAAAAAAAAEluZm8AAAAPAAAHLgADCBw(...TRUNCATED)
198,729
alp.question
en
108
2
audio.class
"transformers/src/transformers/models/data2vec/audio.class.configuration_data2vec_text.Data2VecTextC(...TRUNCATED)
"transformers/src/transformers/models/data2vec/audio.class.alp.answer.configuration_data2vec_text.Da(...TRUNCATED)
2,479,259
"SUQzBAAAAAAAI1RTU0UAAAAPAAADTGF2ZjU4Ljc2LjEwMAAAAAAAAAAAAAAA//NYwAAAAAAAAAAAAEluZm8AAAAPAABZqQAl1AA(...TRUNCATED)
2,479,149
alp.answer
en
108
2
audio.class
"transformers/src/transformers/models/data2vec/audio.class.modeling_data2vec_vision.Data2VecVisionPr(...TRUNCATED)
"transformers/src/transformers/models/data2vec/audio.class.alp.question.modeling_data2vec_vision.Dat(...TRUNCATED)
197,983
"SUQzBAAAAAAAI1RTU0UAAAAPAAADTGF2ZjU4Ljc2LjEwMAAAAAAAAAAAAAAA//NYwAAAAAAAAAAAAEluZm8AAAAPAAAHJgADBLw(...TRUNCATED)
197,865
alp.question
en
116
2
audio.class
"transformers/src/transformers/models/data2vec/audio.class.modeling_data2vec_vision.Data2VecVisionPr(...TRUNCATED)
"transformers/src/transformers/models/data2vec/audio.class.alp.answer.modeling_data2vec_vision.Data2(...TRUNCATED)
808,723
"SUQzBAAAAAAAI1RTU0UAAAAPAAADTGF2ZjU4Ljc2LjEwMAAAAAAAAAAAAAAA//NYwAAAAAAAAAAAAEluZm8AAAAPAAAdPQAMVnA(...TRUNCATED)
808,605
alp.answer
en
116
2
audio.class
"transformers/src/transformers/models/data2vec/audio.class.modeling_data2vec_vision.Data2VecVisionPa(...TRUNCATED)
"transformers/src/transformers/models/data2vec/audio.class.alp.question.modeling_data2vec_vision.Dat(...TRUNCATED)
197,335
"SUQzBAAAAAAAI1RTU0UAAAAPAAADTGF2ZjU4Ljc2LjEwMAAAAAAAAAAAAAAA//NYwAAAAAAAAAAAAEluZm8AAAAPAAAHIAADAjQ(...TRUNCATED)
197,217
alp.question
en
116
2
audio.class
"transformers/src/transformers/models/data2vec/audio.class.modeling_data2vec_vision.Data2VecVisionPa(...TRUNCATED)
"transformers/src/transformers/models/data2vec/audio.class.alp.answer.modeling_data2vec_vision.Data2(...TRUNCATED)
1,341,811
"SUQzBAAAAAAAI1RTU0UAAAAPAAADTGF2ZjU4Ljc2LjEwMAAAAAAAAAAAAAAA//NYwAAAAAAAAAAAAEluZm8AAAAPAAAwhQAUeNA(...TRUNCATED)
1,341,693
alp.answer
en
116
2
audio.class
"transformers/src/transformers/models/data2vec/audio.class.modeling_data2vec_vision.Data2VecVisionEm(...TRUNCATED)
"transformers/src/transformers/models/data2vec/audio.class.alp.question.modeling_data2vec_vision.Dat(...TRUNCATED)
196,142
"SUQzBAAAAAAAI1RTU0UAAAAPAAADTGF2ZjU4Ljc2LjEwMAAAAAAAAAAAAAAA//NYwAAAAAAAAAAAAEluZm8AAAAPAAAHFQAC/ZA(...TRUNCATED)
196,029
alp.question
en
111
2
audio.class
"transformers/src/transformers/models/data2vec/audio.class.modeling_data2vec_vision.Data2VecVisionEm(...TRUNCATED)
"transformers/src/transformers/models/data2vec/audio.class.alp.answer.modeling_data2vec_vision.Data2(...TRUNCATED)
1,170,086
"SUQzBAAAAAAAI1RTU0UAAAAPAAADTGF2ZjU4Ljc2LjEwMAAAAAAAAAAAAAAA//NYwAAAAAAAAAAAAEluZm8AAAAPAAAqTwAR2gg(...TRUNCATED)
1,169,973
alp.answer
en
111
2
audio.class
End of preview. Expand in Dataset Viewer.

Python Copilot Audio Training using Class with Knowledge Graphs

This dataset is a subset of the matlok python copilot datasets. Please refer to the Multimodal Python Copilot Training Overview for more details on how to use this dataset.

Details

Each class method has a question and answer mp3 where one voice reads the question and another voice reads the answer. Both mp3s are stored in the parquet dbytes column and the associated source code file_path identifier.

  • Rows: 135496
  • Size: 284.6 GB
  • Data type: mp3
  • Format: narrated alpaca question and answer pairs using two voices

Schema 

{
    "audio_path": "string",
    "audio_type": "string",
    "dbytes": "string",
    "dbytes_len": "int64",
    "file_path": "string",
    "file_path_len": "int64",
    "lang": "string",
    "lang_len": "int64",
    "recsize": "int64"
}

How to use the dataset 

from datasets import load_dataset

ds = load_dataset("matlok/python-audio-copilot-training-using-class-knowledge-graphs-2024-01-27", data_dir="files")
Downloads last month
78
Size of the auto-converted Parquet files:
981 MB
Number of rows:
948

Collection including matlok/python-audio-copilot-training-using-class-knowledge-graphs-2024-01-27