luap, you seem to think in English and transfer this thinking into Lithuanian, which doesn't work. But as you learn Lithuanian, you will find yourself making fewer mistakes of this kind (an encouragement not to fear to make mistakes).
I am sorry for my Lithuanian
Aš esu atsiprašau per mano lietuviškai
- word for word translation.
The case is, that in Lithuanian the phrase 'to be sorry' works in a different way to that of English. If English used the same system as Lithuanian, instead of 'to be sorry' you would say 'to sorry':
to sorry - sorried - sorried
I sorry for my mistakes. She sorried to have said such bad things about him.
So, it's 'atsiprašau', which would literally translate as 'I sorry/I am sorrying'.
The verb 'atsiprašyti' takes the preposition 'už', not 'per' (per is used with time/place), so it's 'atsiprašau už' (I am sorry for).
Finally, we don't say 'for my Lithuanian'. We usually say 'for the mistakes'. So
Atsiprašau už klaidas
/personal pronoun 'aš' (I) is left out since using it is redundant. Of course it's absolutely correct to use it but usually we omit it./
I hope this helps and please correct my English mistakes since I also want to improve.