The following commands show the failure:
$ mkdir d && touch d/f
$ mkdir g && cd g && git annex add ../d/f
add ... ok
error: Invalid path '.git/annex/objects/Jx/...
...
Then it seems it is enough to 'git add ../d/f' to complete the operation.
Thanks for reporting, fixed --Joey