Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Memory use spikes up with iotable_get() #29

Open
rafserqui opened this issue Dec 8, 2024 · 1 comment
Open

Memory use spikes up with iotable_get() #29

rafserqui opened this issue Dec 8, 2024 · 1 comment

Comments

@rafserqui
Copy link

The following code spikes memory up to 28GB when calling iotable_get() then crashes.

  • iotables version: 0.9.3
  • R version: 4.4.2
  • Both on Windows and Pop!_OS
library(iotables)
library(tidyverse)
library(here)

# Getting the data
naio_10_cp1750 <- iotables_download("naio_10_cp1750",
    data_directory = here("data/naio-10-cp1750/"))

# Filter countries and year
c_naio <- naio_10_cp1750 %>%
    filter(geo %in% ccodes$country_code[2]) %>%
    filter(year %in% c(2015))

# Obtain the IO-Table
io_tables <-  iotable_get(labelled_io_data = c_naio,
    source = "naio_10_cp1750", geo = "BE",
    year = 2015, unit = "MIO_EUR",
    stk_flow = "IMP", labelling = "short",
    data_directory = here("data/naio-10-cp1750/"))
@antaldaniel
Copy link
Contributor

Yes, indeed, I want to write a new function, because unfortunately the downloader first downloads the entire statiscal dispatch from Eurostat, which has grown considerably since the first release of the package.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants