21 May 2022 |
soim12 | Hi guys | 17:27:35 |
soim12 | is there any workaround for circular references in scala reflection? | 17:27:52 |
22 May 2022 |
| hr24official joined the room. | 12:05:51 |
Majestic#1066 | I don't think this is Spark specific, maybe try #scala-users ? | 14:23:05 |
soim12 | Scalareflection is a Part of spark catalyst api..for datasets | 14:23:47 |
Majestic#1066 | oh right | 14:24:05 |
Majestic#1066 | sorry | 14:24:19 |
soim12 | Ah it's fine.I know it's an issue in spark,so I thought someone here would have a workaround | 14:25:04 |
Majestic#1066 | Just curious, is it because you have 2 case classes referencing each other, or is it coming from Java Protobuf/Avro generated classes..? | 14:37:44 |
| tiki joined the room. | 14:47:54 |
23 May 2022 |
| maxo joined the room. | 04:51:50 |
| BiancaMarcucci joined the room. | 11:32:04 |
| akshay joined the room. | 15:11:43 |
| raishad joined the room. | 16:42:55 |
| AGUIE joined the room. | 17:43:59 |
| Dynam1co joined the room. | 19:51:42 |
Dynam1co | Hello all, next week I'll have the exam for Databricks Apache Spark certification. I have been working with Scala-Spark from last 6 months. Any tip? | 19:51:46 |
Dynam1co | * Hello all, next week I'll have the exam for Databricks Apache Spark certification. I have been working with Scala-Spark from last 6 months. Any tip? | 19:51:46 |
24 May 2022 |
| steve-comcast joined the room. | 22:53:41 |
25 May 2022 |
| MridulGupta | GithHubSRM joined the room. | 00:24:58 |
| rhansen joined the room. | 12:53:09 |
| Billzabob joined the room. | 17:24:03 |
| maxo changed their display name from maxo to maxo#0417. | 21:24:42 |
| maxo changed their display name from maxo#0417 to maxo. | 21:24:52 |
| ACE81 joined the room. | 23:08:53 |
26 May 2022 |
| milestobudapest joined the room. | 09:21:27 |
paddenpaadje | How do I join two datasets when one id is Long and other is Option[Long] | 11:44:04 |
| Nicolas joined the room. | 12:12:15 |
Majestic#1066 | I guess using joinWith() and describing the join condition with Column type it works. It just won't match on None ids. Did you try it? | 18:22:56 |
paddenpaadje |  Download unknown.png | 20:57:26 |