Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dependency: add support for loading auxiliary code as LLEXT modules #9399

Draft
wants to merge 14 commits into
base: main
Choose a base branch
from

Conversation

lyakh
Copy link
Collaborator

@lyakh lyakh commented Aug 23, 2024

At the moment LLEXT modules can only be instances of the Module Adapter API. This PR adds ability to load arbitrary code as LLEXT into SOF e.g. to provide functionality by exporting symbols for other LLEXT modules. Requires a yet unmerged Zephyr PR

@lyakh
Copy link
Collaborator Author

lyakh commented Aug 23, 2024

also needs thesofproject/linux#5156

@lgirdwood
Copy link
Member

also needs thesofproject/linux#5156

Can this PR be split into smaller PRs ? I suspect we have cosmetic. fixes and the new feature patches here?

@lyakh
Copy link
Collaborator Author

lyakh commented Aug 23, 2024

also needs thesofproject/linux#5156

Can this PR be split into smaller PRs ? I suspect we have cosmetic. fixes and the new feature patches here?

@lgirdwood yes, I'd say - this is just my current state dump, will be split

lyakh added 14 commits January 24, 2025 14:40
Add a dedicated type for auxiliary LLEXT objects, not implementing
the Module Adapter API.

Signed-off-by: Guennadi Liakhovetski <[email protected]>
FIR support code is used by eq-fir and by tdfb. When both of them are
built as LLEXT modules, FIR supporting functions can be dynamically
loaded too.

Signed-off-by: Guennadi Liakhovetski <[email protected]>
llext_manager_link() doesn't the whole of struct module_data, it only
needs a pointer to a pointer to struct llext. Modify it to only
receive the scope, that it needs.

Signed-off-by: Guennadi Liakhovetski <[email protected]>
The LLEXT context is currently bound to the Module Adapter API which
shouldn't be the case because we also need generic LLEXT-based
loadable SOF objects. This patch moves the context to struct
lib_manager_module which is safe, because the library manager is
always needed when dynamically loading modules.

Signed-off-by: Guennadi Liakhovetski <[email protected]>
Currently lib_manager_module_free() first checks, if an LLEXT module
is being freed. If so, it first calls llext_unload() and then - if
the use-count is reported as zero, calls llext_manager_free_module().
Simplify this process by just calling llext_manager_free_module() and
letting it handle llext_unload() internally.

Signed-off-by: Guennadi Liakhovetski <[email protected]>
This reverts commit cf31c9c. We do
now need to store BSS information for auxiliary LLEXT management.
When instantiating such a module for the second time, we don't have
access to Zephyr LLEXT information any more, so we need to use our
cached information for .bss allocation.

Signed-off-by: Guennadi Liakhovetski <[email protected]>
Extract localisation and linking of a single LLEXT module into a
separate function, it will be re-used for auxiliary modules.

Signed-off-by: Guennadi Liakhovetski <[email protected]>
Auxiliary modules, implemented as LLEXT and used to provide
functionality for other modules, don't have TOML configuration, make
rimage skip that step for them.

Signed-off-by: Guennadi Liakhovetski <[email protected]>
Add comments to two structure fields, whose meaning isn't immediately
obvious otherwise.

Signed-off-by: Guennadi Liakhovetski <[email protected]>
llext_manager_load_module()'s ebl argument is only used for .bss
alignment. Calculate it automatically to eliminate ebl, because it
isn't available during following loads. e.g. when reloading
dependencies.

Signed-off-by: Guennadi Liakhovetski <[email protected]>
Let llext_manager_mod_init() calculate mod_array itself internally,
it has all the data for that.

Signed-off-by: Guennadi Liakhovetski <[email protected]>
We need to initialise library context once for each loaded library.
Instead of doing it at link time while checking, if it has already
been initialised, we can do that at load time.

Signed-off-by: Guennadi Liakhovetski <[email protected]>
Add support for auxiliary modules, exporting symbols to other
modules. In such cases Zephyr LLEXT API generates a dependency list,
but it is only available while the dependent module is loaded. SOF
can unload that dependent module from SRAM while still relying on it
being present in a resolved state in DRAM. Then on a subsequent
loading of that dependent, we don't need to regenerate the dependency
list. For that we store it ourselves in module context.

Signed-off-by: Guennadi Liakhovetski <[email protected]>
Zephyr PR 84389 enables dependencies, but as it stands it will need
some rework.

Signed-off-by: Guennadi Liakhovetski <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants