Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Switch to file IO in pool2 instead of mmap, to support OSX #4

Open
mjuric opened this issue Mar 3, 2011 · 0 comments
Open

Switch to file IO in pool2 instead of mmap, to support OSX #4

mjuric opened this issue Mar 3, 2011 · 0 comments
Assignees
@mjuric

Comments

@mjuric
Copy link
Owner

mjuric commented Mar 3, 2011

OSX' HSF+ filesystem does not support sparse file so backing to disk is disabled on OSX in pool2 mapreduce engine. Since there appears to be no need to use mmap instead of normal file IO, we should switch to the latter in pool2 and enable backing to disk for OSX.
mjuric pushed a commit that referenced this issue Jun 16, 2011
Improve the lookup of .join files
ce6cad4 
Modify the lookup algorithm to do the following:

	given "... FROM A, B ..."

	#1 first look for A:B join files in A's directory
	#2 if that fails, look for A:B join files in B's directory
	#3 when a potential match is found, prefer resolving the other
	   table to the same dbdir where the .join file resides
	#4 if you can't, look for it in other dbdirs, in order they
	   show up in LSD_DB

tables with the same name in two different LSD_DB directories.
@ghost ghost assigned mjuric Jul 25, 2011
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@mjuric mjuric

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@mjuric