Add adaptive replacement cache #118

qwe661234 · 2023-03-03T14:13:10Z

Current basic block management consumes a significant amount of memory, which leads to unnecessary waste due to frequent map allocation and release. Adaptive Replacement Cache (ARC) is a page replacement algorithm with better performance than least recently used (LRU). After the translated blocks are handled by ARC, better memory usage and hit rates can be achieved by keeping track of frequently used and recently used pages, as well as a recent eviction history for both.

According to the cache information obtained while running CoreMark, the cache hit rate of ARC can reach over 99%.

see #105

src/cache.c

src/list.h

src/cache.h

Makefile

src/cache.c

src/cache.h

Makefile

src/cache.c

src/cache.h

src/emulate.c

src/cache.h

src/list.h

jserv · 2023-03-03T15:11:25Z

Check the build system of linux-list for building test programs.

qwe661234 · 2023-03-03T16:34:53Z

Check the build system of linux-list for building test programs.

Does the test programs here means new test case for testing cache?

jserv · 2023-03-03T16:41:39Z

Does the test programs here means new test case for testing cache?

Exactly. These test programs should be built and verified before we integrate ARC into rv32emu core.

jserv

All test cases should be built from top-level Makefile.
Test specific file should be placed in tests directory, and there are no file names in upper case.
Show report of test cases and integrate into GitHub Actions.

src/cache.c

src/cache.h

src/list.h

tests/cache-test/src/testCache.c

mk/cache-test.mk

src/cache.c

.github/workflows/main.yml

jserv · 2023-03-12T12:54:40Z

mk/tests.mk

+	$(VECHO) "  CC\t$@\n"
+	$(Q)$(CC) $^ -o $(CACHE_BUILD_DIR)/$(TARGET)
+
+$(CACHE_BUILD_DIR)/cache.o: src/cache.c 


You can unify the rules by the following:

$(CACHE_BUILD_DIR)/%.o: $(CACHE_TEST_DIR)/%.c

The directory of cache.c is src, but the directory of test_cache.c is tests/cache. So I cannot nuify the rules to this.

No, you don't have to build $(CACHE_BUILD_DIR)/cache.o. Instead, only $(CACHE_BUILD_DIR)/test_cache.o should be built here. The test oriented rules always depend on the generation of $(OBJS).

I see, cache.o would be built by make all

However, the GitHub Action fails now, because we don't integrate the cache and it does not build cache.o.

The appropriate sequence would be

make make tests

Alternatively, you can extend item check to perform make tests.

By the way, the next tests would be associated with #94 .

src/cache.h

mk/tests.mk

src/cache.c

jserv

For the consistency, file name would use dash (-) rather than underscores (_). One exception is to emphasize the items you want to validate. e.g., test-cache_t. In this pull request, we can safely enforce the replacement for all underscores.

.github/workflows/main.yml

jserv

Resolve CI pipeline failure.

Current basic block management consumes a significant amount of memory, which leads to unnecessary waste due to frequent map allocation and release. Adaptive Replacement Cache (ARC) is a page replacement algorithm with better performance than least recently used (LRU). After the translated blocks are handled by ARC, better memory usage and hit rates can be achieved by keeping track of frequently used and recently used pages, as well as a recent eviction history for both. According to the cache information obtained while running CoreMark, the cache hit rate of ARC can reach over 99%.

tests/cache/test-cache.c

github-advanced-security bot found potential problems Mar 3, 2023

View reviewed changes

src/cache.c Fixed Show fixed Hide fixed

src/list.h Fixed Show fixed Hide fixed

src/list.h Fixed Show fixed Hide fixed

src/cache.h Fixed Show fixed Hide fixed