-
Notifications
You must be signed in to change notification settings - Fork 4
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Implement tar_sf_* family of targets #13
Comments
Some ideas of what could be implemented for object types in {sf}
For vector data, filetypes supported by GDAL for read/write could be used as the format for the file in the target store (including Parquet/Arrow), or you could use {arrow} per discussion in #2. Using arrow is probably a great default behavior for vector data due to efficiency/small size. Since sf objects in memory do not have issue with having an internal pointer, they can be serialized to normal 'rds' format files as well. In the case of sfc/sfg only one column is being managed, but storage formats would likely be similar to what would be used for For other classes in {sf} like bbox/crs I don't think there is much benefit to having specific methods for these, they are simple enough to store with |
Hello! Thanks for working on that this is great! A quick idea/question: sf is using two different engine (geos, s2) and use a setting function (sf_use_s2) to affect that. What could be a desired design for dealing with it in a "target" mindset? Is it something that should be set for a specific target or set at the workflow (or it depends)? |
I'm currently including |
In my work I have had cases where I set Errors like this come up a lot with invalid geometry
These things are usually fixable by For geotargets, I think we can't assume the user is going to always be working with valid geometries, nor do we want to "fix" them for them. I think there should be a way to set/get the sf option "sf_use_s2" for a whole workflow as the results will subtly differ depending on the engine used |
Makes sense. So we'll add |
I am running in the same "issue" describing by @brownag (s2 is a bit more "difficult"). If my understanding of how library("sf")
sf_use_s2()
#[1] TRUE
jim <- function() sf_use_s2(FALSE)
jim()
#Spherical geometry (s2) switched off
sf_use_s2()
#[1] FALSE I think adding in the options_set is a good idea. The topic of invalid geometry is an important one that also probably deserve it specific issue (it will also depend on GEOS version). |
Since each target is run in a separate clean R session, it shouldn't be a problem to include |
This can probably be solved with |
Related to #4
We need to list the datatypes from
sf
that we want to supportThe text was updated successfully, but these errors were encountered: