For our heart
leb (labe)
the heart; also used (figuratively) very widely for the feelings, the will and even the intellect
shall rejoice
samach (saw-makh')
probably to brighten up, i.e. (figuratively) be (causatively, make) blithe or gleesome
in him because we have trusted
batach (baw-takh')
to hie for refuge; figuratively, to trust, be confident or sure -- be bold (confident, secure, sure), careless (one, woman), put confidence, (make to) hope, (put, make to) trust.
in his holy
qodesh (ko'-desh)
a sacred place or thing; rarely abstract, sanctity -- consecrated (thing), dedicated (thing), hallowed (thing), holiness, (most) holy (day, portion, thing), saint, sanctuary.
name
shem (shame)
an appellation, as a mark or memorial of individuality; by implication honor, authority, character -- + base, (in-)fame(-ous), named(-d), renown, report.