This phase I trial studies the side effects and best dose of lenalidomide when given together with ibrutinib and rituximab in treating patients with chronic lymphocytic leukemia or small lymphocytic lymphoma that has come back (relapsed), has not responded well to prior treatments (refractory), has spread to other parts of the body (metastatic), or cannot be removed by surgery. Biological therapies, such as lenalidomide, use substances made from living organisms that may stimulate or suppress the immune system in different ways and stop cancer cells from growing. Ibrutinib may stop the growth of cancer cells by blocking some of the enzymes needed for cell growth. Rituximab is a monoclonal antibody that may interfere with the ability of tumor cells to grow and spread. Giving lenalidomide together with ibrutinib and rituximab may kill more cancer cells.