Hi @michael-platzer, @kuoyaoming93. Sorry that I opened another issue since the question I ask now is the same that I asked in https://github.com/vproc/vicuna/issues ...

But later I found locally connected is so slow which makes it useless for my problem. Then I started to write a custom layer but it doesn't work and gives me the ...