This article explores the use of deep neural networks for natural language processing tasks in code-switched colloquial languages. The study focuses on Algerian language as it is used in social media and experiments with five different tasks. Results show promise for end-to-end DNNs with character-level representation of data.