Example with publication data | Importation | Importing with preprocessing | Manipulation | Exploring a hdd data set | Extracting a full variable | Reading full hdd data sets from disk to memory | Slicing | Speed considerations and limitations | In-memory operations will always be faster | On aggregation | References
Package: hdd 0.1.1
hdd: Easy Manipulation of Out of Memory Data Sets
Hard drive data: Class of data allowing the easy importation/manipulation of out of memory data sets. The data sets are located on disk but look like in-memory, the syntax for manipulation is similar to 'data.table'. Operations are performed "chunk-wise" behind the scene. See <https://lrberge.github.io/hdd/> for more information.
Authors:
hdd_0.1.1.tar.gz
hdd_0.1.1.zip(r-4.7)hdd_0.1.1.zip(r-4.6)hdd_0.1.1.zip(r-4.5)
hdd_0.1.1.tgz(r-4.6-any)hdd_0.1.1.tgz(r-4.5-any)
hdd_0.1.1.tar.gz(r-4.7-any)hdd_0.1.1.tar.gz(r-4.6-any)
hdd_0.1.1.tgz(r-4.6-emscripten)
manual.pdf |manual.html✨
DESCRIPTION |NEWS
card.svg |card.png
hdd/json (API)
| # Install 'hdd' in R: |
| install.packages('hdd', repos = c('https://lrberge.r-universe.dev', 'https://cloud.r-project.org')) |
Bug tracker:https://github.com/lrberge/hdd/issues
Last updated from:cd78d5962a. Checks:9 OK. Indexed: yes.
| Target | Result | Time | Files | Syslog |
|---|---|---|---|---|
| linux-devel-x86_64 | OK | 141 | ||
| source / vignettes | OK | 193 | ||
| linux-release-x86_64 | OK | 126 | ||
| macos-release-arm64 | OK | 119 | ||
| macos-oldrel-arm64 | OK | 76 | ||
| windows-devel | OK | 105 | ||
| windows-release | OK | 88 | ||
| windows-oldrel | OK | 87 | ||
| wasm-release | OK | 110 |
Exports:getHdd_extract.capguess_col_typesguess_delimhddhdd_mergehdd_setkeyhdd_sliceoriginpeekreadfstsetHdd_extract.captxt2hddwrite_hdd
Dependencies:bitbit64clicliprcpp11crayondata.tabledreamerrFormulafstfstcoregluehmslifecyclemagrittrpillarpkgconfigprettyunitsprogressR6Rcppreadrrlangstringmagictibbletidyselecttzdbutf8vctrsvroomwithr
Readme and manuals
Help Manual
| Help page | Topics |
|---|---|
| Easy manipulation of out of memory data sets | hdd-package _PACKAGE |
| Extraction of HDD data | [.hdd |
| Extracts a single variable from a HDD object | $.hdd |
| Dimension of a HDD object | dim.hdd |
| Guesses the columns types of a file | guess_col_types |
| Guesses the delimiter of a text file | guess_delim |
| Hard drive data set | hdd |
| Merges data to a HDD file | hdd_merge |
| Sorts HDD objects | hdd_setkey |
| Applies a function to slices of data to create a HDD data set | hdd_slice |
| Variables names of a HDD object | names.hdd |
| Extracts the origin of a HDD object | origin |
| Peek into a text file | peek |
| Print method for HDD objects | print.hdd |
| Read fst or HDD files as DT | readfst |
| Sets/gets the size cap when extracting hdd data | getHdd_extract.cap setHdd_extract.cap |
| Summary information for HDD objects | summary.hdd |
| Transforms text data into a HDD file | txt2hdd |
| Saves or appends a data set into a HDD file | write_hdd |
